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There. is ; provided. an , editing ^method, and, an - 
editing system for conducting, editing. processing on. a, u . . , 
vtdeo information material containing; sound information^ . 
and moymg picturejnformatioa with .the aid of a compu- _ ^ 
ter. Informaton ,of the. .video,. information. material, is * 

stored in /) a 1 storage.device 1 (506). The video information ' 

is read out from t the storage.device,(506). The. read, out . , 

934) is displayed on, the.screen ota.display ..device.. An - . , 
editing posjbpn of 5 the^idepjnforr^ 

th e videp^infor fji^tion gf^ ft 89C^> f< n * 8 

mand frqm.a t yser, Upon, ?,oo^n^rWir6ni .theTusefl '^eV f . " : .. . . 
editing p"c«H^ 

altered. Editing processing ( 1 JO. , 61 J^TI ; . ^1305). Sf>ec-». \ ryt 
rf ied by { the user is, xprdurt^J on r-y|dep ijnforrratipn. , v * 
located jn^thel ,cfi ^splayed k i^ting^ J^sigonXj^^ t 'i^^''-' . . 
video infprrriat^ 
screen. 
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BACKGROUND OF THE INVENTION 
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configuration having ' a central ^ocessingrunrt.^a.m^nv 
ry and various devices operated by an operatoK^f ' 
FIG. 4 shows an example of an image editing sys- 
Q . . h tera The ^ge.editing system has a computer 401. To 



The present invention relates to editing processing 
of moving images. such as video pictures and sounds, 
and in particular to an image edit ng method and an 
image editing apparatus suitable fo^creation of ^televi- 
sion broadcast programs and video programs, and to a 
medium having a program recorded thereon to make a to 
computer execute image editing processing operation. 
In recent years, methods for creating tele 

vision broadcast programs ^"arid^deo programs; 
enhanced by using computers have been raptcflyov> 
advanced. Instead of video editing techniques^ usjng^TS 
a video tape recorder and repeating the fast .feed iandr>o>4 
rewinding operation, editing is conducted by^usings-uK 
images stored in a hard disk which is inexpensive and3o> : 
easy to handle and preserve. Moving imagexedjting&si; 
apparatuses using such techniques of so^cal|ed : direct>k:2p 
scheme have recently attracted attention. 

In JP-A-4-207877. there is disclosed ^movingq~ c 
image managing apparatus ..fer^displayirigU movirig3ttA 
images on a screen in a hierarchicalrstructure of- a tree^te c ? 
form including cuts arid; scenescahd conducting edrtingu-is 
by taking a scene or a cut as the-uhit i^lealeO . leJt^wrtoiH 

Herein, the term "moving image" mearis^imageH&fJ 
information which contains pictures (of^an plurality" bi d re 
frame urnts or j>ound information or both of them PJ^f[[j!^lJ5>^^ 

arranged respectively independently in time series and 30 apparatus, i.e., the video capture/ frame storage unit 
which can be displayed Amoving TrragesbnE iWuemco )o ^.ffift^Bfcfiffi^ 

As for the image editing work, work to be decided erator 405. u „^ rf . _- t >... h .. } . 
by using the sensitivity of an editor js main work in any For lOfie $MCirip»TCe f S "fliSredid i^worft aMJotKer* wcvks 
case. As for the image editing method, an apparatus of to be theVexec^e^ Q 
a scheme of conducting image editing by using the dis- 35 disk stDra^e^Onif '^b^ jcarTj^yM^jiifit 'frainri the'th^'disK'J 
play for manipulating^ storage unit 406; and y rea8 into the video capture/frame 
ing screen;"^--' ^^^VSf^^sfei^lb-i-J. ^^MZtsaMK^-^ ,r UCX " 

referred to 
tion is used 

In the corw&t^ 
ing appara^s;£effec^^ a 
desired cut (a series ota pfuraTr^ 
included in time sV»^4deo picture materials (riibying_ ■ 
pictures) or a scene formed by - a pluralityTbflculs { ar^ 
another desired cut~or~N^^ "".jw 
show examples of screen, display cto 
That is. in the effect editing, a picture is switched oyer to ! 
another one while- the contents- of -the picture^ is - 
changed. 

First of all, FIG. 2 shows an example of display of a 
screen for the computer aided editing work. FIG. 3 is a 
different example of display of a screen for the computer 
aided editing work. Both of these editing works use rep- 
resentative software for picture editing which is com- 
mercially available. 

The general configuration of the editing apparatus 
used at this time is a system based upon a computer. To 
be more concrete, "it is a typical and general-purpose 
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the 'computer '401* a v 'monitor 407 including a display 
screen having a size of. for example. 19 inches is, con- . 

nected. rq^r.^t f >>o!t«*R ftftpr.rr».0 r . 

A video reproduction unit (VTR) 402 can reproduce 
any video information (imape mfprrt^ation^ pf f trie,,NTSC ^ , . , . . 
system, PAL system, or any other format system. The' 
video information reproduced by this yideo^ reproduction . ; ( § 3 ; 
unit 402 is sent to a video capture/ frame storage unit 
~403; "arid convert ed into "digital infer rriatibrTarid "stored 
/therein. :eeif*3 gnfonTioO bsSgnge^G <-B> 

; The t videp. inf ormationithus stored in ;the; video cap=;> 
ture/ frame storage unh 403 is then supplied to; a disk tf 
. accelerator 405 via an expander^cprrpressor:'4Q4.sr^i^C 
: This expander/compressor 404 functions' to^cornri A 
- press and expand video information. An expand- 
ing/compressing processbr>iisirig SaSUPEG (Joints 
Photographic coding ExpertsXGr6up)vchip having the 
('highest rate at the present time is often used. 

The disk accelerator 405 functions to transmrFthe' 
videb information seWfrorrfth^ u ™*!^ 
402; to the video capture/ frame 3m^ r unit r 40$§ny^' 
stored therein to at least one disk storage unit 406, or 
functions to receive information therefrom. 

'By using control signals 408, 409 and 410, the com- 
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In accessing' desired' video information, tfie I appara-' 
tus shown' in F^ it can "immedi- ; 

ately" access* e', S; rancjomly i ^ 'access) * thV : ^df o ' • 
iritormatiorfuniike the L conventional sequerrtialfile apipa-^' 
ratus needing the; rewinding operation of the video tape 
in principle? As described 'above, therefore," the tech^ '''' 
nique of the direct scheme is used. * " 1 

The afc5emention^ srww^first 'and \ 

second 'exampfes'of a r screen 1 for ttie ^rjSng' wrkjdBs'; 
played on the ''monitor ^407* respectively. In' FIGS. 2 and 1 
3, vertical lines denoted by numerals 210 and 313 are : 
figures for indicating the reference position at the time of 
editing work, and they are called cunent position bars. 

Numerals 302 and 303 on the screen of FIG. 3 
denote time lines for relatively indicating the position 
and the range of a cut or a scene to be edited on the 
basis of the position of the above described current 
position bar. For each picture information (image infor- 
mation) to which the cut or scene to be edited belongs, 
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a track. for time'line; display is assigned and^a corre-rmngrr. Subsequently; the bar. 210 is moved to the position' 
spending track name is provided. J>s:oubr.y.:. :.r> :ny- of the coupling of the two video materials by the mouse! C ,n y r 

Omthe ;screen«bfi FIG.' 2;v numeral 203 denotes a As a result, theeffect editing is started in the position of^ hiv 
time line- forArelatively indicating: the positibn^and the*^..:the moved bar 210. *ni io *nesrr ^ atesfe s»lil» 9 ;^-^' 
range of a cut or a scene!after the ecSting: On the screen* tfsitit: In other words, editing'wdrk desired by"the useris : if> c 
of FIG. 3, numeral 304denotesa timeline indicating the -i *\ { /conducted bjTmahipulatin^ 

range of synthesis: when:pidures<pt the:two time: lines t an effect kirioV a window 209 in which ah^eflecYtime can* 11 ' 1 
302 and 303 are combined : and edited^os b^Ji'^v *---:'.-.-h be set by'meanVol a^numerical input from a* keyboard' '^ i!t " ' 

Each'.of numeralsv20lr(FIG. -2)s arid* 30lo{FIGL*3).*L*^ (not illustrated) aihne^e^^ 
denotes : a* time~ line windows On: the 7 window; ;i the above c& io r same way as tfie : mbuse^ anS sliders" allowing i the user*** < ' r 5 * 
d escribed time: line is displ ayed. The time lin es 203. 302 • i o i p <? l to set other values; such' as the width' of the boundary of v ■" ' 1 
and 303r can: bes moved Hh- a scroll ^ manrietfby 'screen qr? .::the vertical wipe in the scene transition from the left to 
manipulation^^ rtl tec*: icil toisupco si Hiss fic«ri .Gscte ?! ?Tthe rightf or thegradatiori^uartrty.*^ sni oi .-<«/is**jp^c::,:" 

NumeraH205<denbtes ; a" program window -In-order: 9- i; r At this time,? a plurality of still pictures 202 after edit- St: «\- 
to confirm a scehe of the image (picture)-of thetimeMineo ^js c ing are arranged and displayed on the time line" windows m «-:•.:■ 
203 displayed^inrthenime .line; window 201; its-image isr* rvr-201 at predetermined frame intervals) Thereby; it is pos-^f 
displayed in the program w ridowv205s according cto to^ 

image infortnation:(videbinf6rrra the "'• or cut. As for the number of frame in the predetermined »f; ~ ~ 

disk storage'unit 406/A'group*- of Jbuttons^for^directing'.r ^ an frame intervals/tvariable setting is possible^ This'setting 'oaec; 
mark-in and mark-out positions which are reproduction*^^ is conducted by selecting a predetermined menu from a~ !, *> *ki >? 
start and:'reprbduction stop : positions~of thenmage dis-'A menu bar included in the program window 205? vxtii^ .&hh 
playing \tfth a^mouse,^ .'>attw tenisfd-j s^l* «t»B.^fifi an*:* ? 

tion devicerconnected to the computer 401: of FIG:; 4 are ^.jcrii Case of FIG. 3 > ^ 1 as-*-" enc« . 

also displayed:'ori o.ij yd ta?-j«lqai noifosn'b emif ri«vv <*v;t a-"Otoie«*t «s*..^o*v -w*. avcsiG t. 

Numerals 206 and 306 denote-'windows? called?*^'" From video: materials differing in scene 1 or^cut dis-^T 
woriongsbin'window? or 'projecrt« windowpiorrdisplaying' : played in the projedTwihdowiSOe^two video ^materials - j: *•■*'- 
video infbrmatidhrflmage inforirotion)*stored in the disk - -.ware selected and disposed on the time' lines 302 'and e-wzic; 
storage unit 406/rnainly edited image, information. l^^' • 303 as role A and role B.i fespecth/ely.v;*: iff! rnoV? o -fi- - 

For cbrTduc^ihgreffe^:editirijg; a Window 305 for dis- 4 v vi3v*j In the case, where two scenes or cuts' are subject tens*^" 
playing ^list of * various Sncleb^ : effect/panerrrsr a nd 'an:- so " synthetic editing, the terms "roll A" and "roir B" are used * >^x. 
effect setting)^ncJcw3312Jfor' / settih^;the"W respectively represent the two scenes or 'cuts^while ^ 

effect or th^ effecti quantity, or a:video effect penel win- ' ' "*•• making a^distinction between them/The synthetic 'edit? 
dow 207> havir^- the> functions of-these two ^windows > ■ ing in this case is also referred to as "AB role editing.^ *ni ^n..-. 
together are'provided:' 1 ^-- <v- i>j=:ol-;v.ib <r.r. st'iawr* rr In order/ torset the effect*timeiithe time>linei303 is?* n^--.-* 

The*effect 'editing is editing [^fbr^conductihg special ' 35'. then moved by -th el mouse :*so~as : to ; attain ; a: predeter--^ '•■ 
effect pr6cessihg-such"ias a wip¥- effe^ 7 c^-i^'dissolve^-:'' *' " y mined overlap width N with ; respect toUhe time'lin'e 302:in i: - 
effect on an image. In the process of 'transrtionMrorh a the direction of the f axis (time axis) of abscissas: *■ £ *> - 
picture A to a picture B. the wipe effect is image If any one pattern is selected by the user out 6f var'^^'W' 

processing (picture processing) c^'eTirraHatirig the pic- ■ 4 ious effect patterns displayed in the video effect pattern * f 5 
ture A from the screen in a certain changing pattern as <o display window 305, then the effect setting window- 312 1 ; 
if it wipes bff the'picture 'A and* instead causing a differ- is displayed, and an effect pattern symbol is displayed in ! : 
ent picture B to appear iri an area from which the picture ■ - the range of the above described overlap s on 'the time £ 
A has beeh'eliminatedr In the process of tfahsitioh from tru ... line 304.^" r "*?oo'a-; ~ %iu*Zi'\ U*& a < "j frwitp :*.i>:^: 
a picture A td a ; 'picture" B. the dissblve^effect is picture s • On the effect setting window 312. the user inputs of • ■* : 7 

prc^essirig of causihg^a pictu^^ the effect /setting * quantity, and conducts-: the 

while causing ■- , th'e'* luminance of thefpicture'A to g/adu- ! v : desired editing work 5 - Q> • -• . : 

ally fall and disappear. In the effect editing, other special v:* " At this time:' still" pictures before editing are dis- - v: • 
effect processings 'other :than the - wipe 'effect* and the ~ played respectively on the time lines 302 and 303 in the ' • 
dissolve^effect'nriay be' also: included.- '"' r5 '- % * : ?-*' '•■ : ■ time line window 30T at predetermined frame intervals. ~ 

Operation required tor the ^effert editing will now be so This setting of the; number of -frame intervals is con- ' 
described in more detail by referring to FIGS: 2 and 3. ^ * ' ducted in a slider 315. 3 ^ - 

«" In the editing "system " described by ' referring to^ 
< Case of FIG.'2>.' 1 ' r i" FIGS. 2, 3 and 4, it cannot be said that sufficient consid- 

k* r i\!fi/nr > ''. n-: n ■ - . j eration is not given to the display required for the image 

For each scene or cut displayed on the working bin - 55 editing, and in particular to its kind selection. The image •* 
window 206." two out of different video materials are first editing work cannot be simplified. The editing system 
selected by manipulation of the mouse and arranged on has problems in "making effective image editihg pbssi- 
the time line 203 in the order of coupling. ' ■- " •* ble. - » - u* • • t 
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In other* words, cfirst in the example of F\IG.*2;; the; c mentation ol each sound, during the reproduction; the : 
editing work is conduct ed. by the. numerical -input frpmr. «n* k. editing is conducted. ••••o • - : ; v « ir- >cr* *. . " 

th keyboard .while, the operatorJs: confirming. the com - • ... The described conventional techniques have V- 

tents of the edited effects by means of the slillrpicturescr i ^. pr0 blenris that sufficient consideration is not given to «; " 
202 displayed at ; the : predetermined Jrame intervals ; ,At n5 facilitating the editing work and the editing work requires ~ - 
this time., howe^r^s^ sWA and a great deal of labor, and time.: .?„ "... 

responding ; tp- ttie e roles^ and B which Js ^effective. - w | n th e . editing according,*) thej conventionah tech- : l>. n« 
fecilrtating the.£B^ ... nique as described above- two VTRs are prepared and--.*'. : 

fore, the operator; cannot ^ reproduced, outputs of them are inputted to the mixer. ^ > 

end point pf a scene^^nsjtion. at the tirne.of^scene^synr, ..jo ^The editor.must manipulate the mixerand determine the.-*'* . ; > 
thesis while, cpnfi™^ fw? f degree '.of .attenuation and the degree ^augmentation y K w 

in 9- a er?i rno^ noin-?-?-.^} &c®z^ sri} ni oqNv iro^.sv s J .during ther reproduction r while listening ;to; the -sounds:^ Nir 

Subsequently, in the examples! FIG>;3; video matef -y. Therefore, high skill is required for the work In addition;^-, 
rials of different scenes displayed in the project window »a in the case where modification, or alteration !of editing te;u, 
306 are.respectivelyiselected and moved onto. the time&it5; ( ;to be conducted;? it is necessary Jto rewind arWB.once -sx c. 
lines 302 and 303^HTie^editing , work is. thus cor^ ;p ; y^and try -again. from the^beginning^ As*, a result; a great >;o> 
whfledisplaying.thepictures:of,theToles A arxJ B^jThere^c^ ak^;;. deal of labor and timerare required. rnfrtoojq edi ni b3v*k:3!b 
fore. the:proWems;,offered in the=case of;FIG: 2!arevnot ;ur. In the sorcalledinonlinear^editing theretofore. used; ; i y sr^ 
posed. Unbl^FIG:2^hpw.eyer^1here is no display corre-i -.n^-the ed*rt[ng:mode.using;the time ; line v scheme forms .the . jJzjh 
spontfing r to; the -.still iptaw^^ ^ rioinv. cw.^tscq Juc-^fi.-n ^r.r r.= -.iw: 

after the effect editing.>Iherefore.;the usen cannot; con-^ i.r..;.fp According,.to this scheme, editing is .advanced by ^ jh-.- 
firm the scene transition state obtained when the effect inserting, materials ot the, video picture, and, sound with -f , x - !,-.; 
editing has been conducted. i £ .£>; 3 io oar Cj mouse t manipulation! in^ a: window vof; strip-like i display^ b - -.vi 

In the above described two examples, therefore, the with the time axis direction replaced by the horizontal >. .. <r. 
start points and. end: points pf the scene .transitions ofov 25 direction of. the display screen. r . o.v- 6G£ s;ct5m s : 
the roler/V;and : role B,to be edited are confirmed. by the toviv^ In this, time line:scheme as. well; however,\both theo, :f; --v. 
picture display/or by. observing the picture f of .the role; AB (e ? ; video picture - and i sound( are -displayed .by j only;, strips. \ , c*. ; 
resulting from the syntheticyediting^Thus; there; remain .?{-. ,. . .having lengths; according:- to, the time I v engths.^respec-.>c.-x»:,- 
problems thattthey cannot be, confirmed quicWy. by .thei tvely. This.results:in a probfem that conducting : the. workup 
picture display . of cthe* timeline window ; - alone , and >djsr.j ?-30 .y . while conf irmingr. the ^.vjdeor pictures is:- difficult when ^ ..^v 
plays 'mustbeiswitched-over^ owl s n ) urez^qs * \ - :i\ rf? ^qe^ . ; determi rdng^ theriedit^ point, jn , the 4 oyerlap^edrting ;-and-?. nrc ■ - . 

In general^rmqvingrimage ? are: accompaniedt by .determining the; mixing start point in the.mixing.editing. - 
sound information? In this case; editing on:sounds;also m : q;:. Examples of the computer aided video and, audio? o a-:. 
becomes necessary^Edrtingr ; modes rof sounds f ;atvthis> : editing systems are disclosed in the user s guide manu-^ . , v - ; 
time are rpughry^classif ied intO;the.fonowi Adobe, l?remiere;.version 4.0 (Adobe\Systemsv * 

A first-mode: isnthe- so^l^cweriap^editi.rig^-yyheni. - Incorporated.^ 994); and * MEDIA SUITE vR.BO; Version-: 
splicing a certain scene of a video pictured to a certain^ j .; • . ... 1 .0 (Avid Technology. : |nc:; 1 994).^ v - b s.-jr. t . . , o ; 
scene of ia video picture. A; sound; A ls: gradually, attenu-^ o;.bt- j rc-sHs ? w' c *?yr.- .1 l a 
atedinthespljdng pIace;ar^sound B is ^ . SUMMAFT/ OP THE. INVENTION -&: .! ;; - . :.<. , 

merrted.sThesevstatesrarepverlapped/'. ai! .?,o* .-.cJvua ■ . * a;. ■■'^it l ^ snior.h.io --.wv:--. ^ r.i .-^v:*.? ? <■ - T ■: ' 

This overlap, editing:is ,used ;f or Jh^ . The present invention provides an .editing: method - 

venting the unnaturalpess caused by a sudden change.^. .and an editing system capable of conducting the, effect . 
of sound at the splicing point and making a smooth tran 7 ;^; editing of .images, that like, pictures or the.; sound, or the :z 
sition between scenes possible. -obn!^ • t:M>> <=r'; r. r ; both of them. simplyrand rapidly by manipulation on a -» .* 

A second: mode is the so-called mixing; editing. 45 computer graphical user interface screen- and provides ; . 
Apart from sounds accompanying the videoimages,:.^ s : . a recording. medium, storing a program for executing the ... 
new sounds are added .to.the video images in the mixing editing processing: £«st : h.„. k^- ■ b ::«';°. l : 

editing, -i f.?i • u r * r o v -»rw= t , The present invention provides an editing- method 

This mixing editing is used when BGM (background and an editing system for conducting editing processing, 
music) or- the. like is; desired, to* be ^accompanied with.**, so on - an image information material . containing sound s 
video pictures. r : .- .; , :, 6 "i / information and moving picture information with the aid o- .. ^ 

According -tofthe^ method : which- has ; become the of a computer, 
mainstream in conventional broadcast program produc-; In the editing method and the editing system 

tion sites when conducting such editing/ two VTRs are ?. : according to the present invention, information of the 
prepared and reproduction outputs of them are inputted f . ss . . image information material is stored in a storage device. 
to a mixer. ,While listening to the reproduced, sounds the { The image information- is read out f rom . the storage v. K 
editor manipulates:.the: mixer While the editor is deter?- device The read out image information is displayed on... .. 
mining the degree of attenuation and the degree of aug- the screen of a display device. An editing position of the 
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image information} is' cfispt axed:, on. the . display of the-o-> 
image information f the screen according to a com-.~>:? 
mand frpj7i;a ; user rj yppa.a command from the user, r ,th_e ^ 
. editing ppj^ipnjs^ajtergd.- Editing prpcesjang,specitied^ ? ... 
by the userJs^cc^ucted^qnjm intorrnation i located; -5 
in the displayed editing posftion^And ^edjtedjn^gejnfpr- 2{ :, 
mation is displayed on the screen. 

Therefore *;the user:can ; conduct editing » processing l-A 
while confirming Jbottuthe i editing; material and the .'edit?-: e 
ing result.si,multaneouslyvOn;the;screen^o-aiK:^att-. .* w lo.^.r 

According .to. an^ernbodiment: of .the present invent o- \ . 
Won, editing of the movjhgpicture informatibh and/or the 1 no -r-o 
sound information can be conducted oh. the screen of sshs!r ; 
the display device?. According to.another, embodiment of eO 
the present inventionfthe display of; relating sound inform u 175 c «: 
mation is altered soias^tobe linked- withithe editing: of vv~- 
the movingi picture informations Accoldihgito^ esutyn 
embodiment- reduced:(contracted)-moving picture infor-r.i oobv 
mation arexreatedbyTeducirig pixels"of the moving picsm aiysi 
ture informationpand^mencohtractedrrro^ 
thus created:are:stored.tn the storage device: Fromrthe:i.-'v 
contracted moving picture information read out from the: c?>: . ^ 
storage cdevicej\ contracted $ moving - pictures ^of la^filmx jA 
image are rcreated/rThei moving .pictures r of the film>: r 
irrwge thusTcreatediare displayed on;the screen as the i ss : 
editing materials & S.O<r loroei*^; \r,\%c, tQH&fa zr.F>?r-. er«: -v 

BRIEF DESCRIPTION OF THE DRAWINGS : sgart.: r>*.w »: 

FIG. 1 is a diagram showing an example of an effect ' 3o; ■■ 
editing screen display according to anrembbdiment s<- 
of the presentunventibn;2fri.v.)i & c: pf-.(^,- oqs«r?? -c^ ^.or- 
FIG;- 2 is a diagram showing an example of a screen ; :> ;~ ;. 
display, of effect editing slji :-{>•- y.-.jqsib fe^eo* !i>«. 
FIG? 3 is: a diagram, showing another example of:a ? 35 ■ . 
screen display of? effect editing;." c^.-'oiq *'n n.>rv« ri 
FIG. 4 is a block configuration?diagram showing an i er. v .- 
example KOf t a>3' moving*- image* editing ^apparatus ' 
according to a conventional tectuiique::- ( v?;d:;a & 5 f V > ' 
FIGi 'Sois aoblockrf configuration diagram of q ari' : 40- . 
embodiment; of .'.a? moving image edrtingtapparatus r. 
according to the present invention; 
FIG? 6 isiai diagrams showing an example of a tree 
structure image on a display screen according to ah ->'■ 
embodiment of thepresent invention;, r> c- \j~ \o.u-. : . . 45. 
FIG; 7 is a data configuration diagram of a picture) 
information: file 'in: an embodiment' of the present 
invention;-- •"!£!■. -Jv ! rr. ^r : : .---iY'v ;-v.;\.i\...v. *. - 
FIG. .8 is -a data configuration diagram of- a hierar- J 
chical structure management information file, in an so . 
embodiment of the'present invention £* 5 . :••"» C: • 
FIG. 9 is a flowxhart:of a program for controlling 
effect editing: in. an r embodiment of the present 
invention;.-..!**- ,»:\r% vsii ." * <.c- : ~.*. . ^ 

FIG:' 10 is a diagram showing an example of a hier- 55 
archical structure^' image v of picture information 
using a combination of representative pictures in an • 
embodiment of the present invention; 



FIG. 11 is a diagram showing a>ibther; example^ a ; L :: :^ 0 
hierarchical structure image of picture information,; : 
using a combination of representative pictures in an 
embodiment of. the present jnyepjtipn^,.,: rt? . .uajis^v.v * 
FIG/ 12 is a diagram showing a.display state before. 1 ki s? 
transition to an effect editing Iscreen display : in an- : < 
embodiment.of the present. invention; ns awoite c O' i 
FIG. f 1 3 is a block diagram showing an example ofa 1 : .-• » 
moving image editing "apparatus used in an.embod-/: a-i ^r; f 
iment: of the present invention j mom f ;? o t i nc * «> 1 *oj » 
FIG: 14 is a : schematic diagram of a display, screen • - - cur; 
before a display, tor editing in, an embodiment of the ? ■: 
present invention; jjneisiaei (aiuioi. ^ -jei!) 9iujC-ut«« «v: 
FIG.: 1 5 is a diagram, showing! operation conducted %vi £ 
by a moving-Jmage 'editjng^apparalus lusediirilan sriu-.ijj 
embodiment of c the present invention; vvb :C/v ^*feni3»m 
FIG^i 1 6; is<a; schematicydiagram showing ranjexamros n oi? 
pie of s anyeditihg.screenvdispl ay r according" to an: -jr^. 
embodiment of the present 5 invehtion;qpib oi a&e&rni pn s 

, FIGS„>: 1 7 A iand si 7Bfaref:examples 1 of; an: editings srscHo 
screen display: according 1 to *an: embodiment otthe»o twi 
present ir»vention;of.K:i v tr ic^s& jq'^c:.' £ .d-^iv^b fuqf :i ^r r c-.. 
FIG: 18 is a diagram for explaining- overlap i sound ic\ - 
editing in r iah/embodiment of the present. invention &A os-a».- 
FIG, ;19 isa schematic diagram of a: display- screen? J 
after.overlap sound editing^in an.embbdimerit of^the^ ■•^ , o- 
present invention; t\v -y^ nicin' c".j;y;q an! o? Jni>iKvi:.ipc* :c-s 
FIG. 20 is a schematic diagram of a reproduction^ v * 
displayrsaeenifbr confirming ithe editing^state-in an:,-- 
embodiment' of the present. invention; .50£ scwir-i: &De"iO/"i 
FIG:^2 Iris ia^schematicvdiag'ramishowingi another^ '»v: 5 ? 
examjDle> of ? an editing- screen-. display.' according:tbi' 'SJ r-: f 
an embodiment of the present irrvention;t?.'T'\otoi .aicm^j. 
FIG:- 22 s is :a^ diagram for;explaining;overlap sound -: 

-editing in the case where a special -effect such: as 
wipe (Or.dissolve has beenrapplied to video pictures,*' i " 
inan embodiment'of the present inventiohlc voi >.!.':- . r . .. 
FIG: '23 is a^diagram forrexplainirig oveflap>sbur^?i:i: 
editing in the case where' a special: effect such as -oo 
wipe or dissolve has been applied to video picturesp^o ' " 
in an embodiment of the present invention; 
FIG. '24; is a i* schematics ^diagram^ showing still 
another example ofe ah: editing.^screen ; cdisplay« 
according to an embodiment of the present inven- 
tion; **i -A i 1 * <*■ r^;r.*r>Gi v --* : . ;-"s*3oVf onx"M 
FIG: 25 is a diagram for explaining the operation. of ■ 
sound mixing : editing! in:j an embodiment « of the'-' * 
present invention; r -r^:.. J." . : „ - v*: r • */.*- ■ • 
FIG. 26 is a schematic diagram of a display screen: 
after sound mixing editing in an embodiment of the - 
present invention; : ^'< ■■*<• • " - 

FIG. 27 is a flow chart showing the procedure of the 
overlap editing shown in FIGS. 17A :and 17B; - 
FIG. 28 is a flowchart showing the procedure of 
wipe editing shown in FIG. 21 ; and - r " i{ 
FIG. 29 is a flow chart showing the procedure of 
mixing editing shown in FIG. 24. 
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DESCRIPTION OFiTHE PREFERRED EMBODIf > *• .OK 

ME NTS c »** :o ^ ' "v- qs 1 «= iwto . pJ Isr^o- bis \n 

r. • 2Q\\Ji 7<«C| f *► j f : "1*3? 'C T '^ «0 J- t:^*tdr:v^.- ? i^rv^J 

Hereafter, an inrage e^rting^ap^ 
the preserrt irWemion will be described in more detail by>i r 5 
referring .to illustrated: embodiments. ic.srte no oi *-oi;ter;-ii* 

FIG. 5 shows an example of a^ardware configurar***? 
tion in am embodiment.^ the '/present: invention? The.V- 
hardware configuration includes a GPU 50l5for L process-^:i 
ing various controls, a monrtori 508 for displaying VahV-.r io 
ous kinds of information, such as image informatiohof a.. i : 
scene and a cut used for image editing and;a ? hierarchir } ed 
cat structure (tree structure) representing thev editing ; q 
state, a: ;merhory, 502 ?. fop storing >various^cbntroJ pro^ ~>r- 
grams c^jthei.GRU{501;Fa/:^oragevc^ce^isuchfas a vis 
magnetic storage device£506 for storing -image' informal m 
tion, sound ;inforrnatiOTKand; editing ihforrnation relating"}' - 
to the infbrmatiorir:a;frame buffer memory '507?»forjstbr-sic: 
ing images to be displayed on thei monitor !508»{a ; scene ms 
change point detector 503 for del ecting a scene chang1eD?"j?0 
point between- cuts j!a;mouse.(ori keyboard) 509 . serving *ov: 
as an input device, a compressor/expander portion 51 1 sxt 
for conpressingrpk^reu information - supplied, from a- 
video tape: recorder (hereafter referred; to: as: VTR) 505 vy=> 
to g en eratec compressed : picture i data: and z expanding^! 25 
compressedipicture; data, to reproduce picture. informa- it • ;? 
tion equivalent to the picture information: supplied; frormv:; 
the VTR 505:bcx?s^ g to ms^-sin ^iJ;irn^,-io3 r c> 02 Oi" 

From the:image information stored in the:magnetic;$fe 
storage device 506, contracted -(reduced) picturesifor.nao 
high speed;; display v obtained.; f rormitheu origi nal ; i mag eD ! 1 
material)! by reducing j;the^infbriTiatipni:coritent^to?r.iw~y.r 
example, information : reduced: by ^1/64: are generated - 
and stored in thes magnetic? storage device ;506~ under . 
the control of .the GRU 50.1: £ s^nw Haeo sni m rrn"ii>35 

The: CPU; 501? the, memory - 502; .the. scener change- ;v 
point detector 503r a video interface! 504v the magnetic? 
storage ;device;506,v and -, the I frame » buffer: memory '507-:. ; : 
are connected? tota-- busjSl 0. :;As{ai result,/ respective rx 
components;:are:- controlled \pyr access <f romuthelGPU -i\40 
501. .rotif , ov*.i *rioii?^q ?rtj ic :''c m f*\\y.-:v^ ~., : . 

In the magnetic storage device? 506, -. the following, 
various kinds: of irrfor rnatipn are stored: * cy ns * t> • sr? • n t 

(a) frame numbers associated with frames in a 45 
series vj of • pictures, c or framescat^ change, points 
detected by the cut change point detector 503; ;:•;••-- 

(b) name of f 3e in which contracted picture data for ? 
high speed, display have been filed;-"* .: - 

(c) name :of file ia which compressed picture data so 
have been filed ; - • ; <r> • • - : -c 

(d) contracted picture data for high speed display; .-' 

( e) compressed picture data ; vr;- : r. r. ■ • • r- > • v. . 

(f) hierarchical number representing a hierarchical 
step number for a plurality of scenes or cuts; •*•!•*.• v, 55 

(g) cut number serially provided in the order of cut 
in a plurality of video image materials;^ ; „ ■ - 

(h) sequence number representing the order, in a 



scene, of each' of ;a^ plurality .^of r cuts forming ^the -?»ri ' 
scene; e oj piibnJXie- 'ir-oo;? ''o^w/m :3b?»- 

(i) identification ihfcrmatioh representing" whether 1 
each" scene or cut r sH6uld be^displayed in a"hierar- c : ; ;V:> ' 3 
chical structure • "when the Hierarchical structure" is 6 * iI ' 5 
cSsplayed on the* hronitor 508; ,jv " ™ ow <v p.if • 

As the magnetic ' Storage device. 506. a- magnetic 
disk, an; optical disk, l /br a different, recording » medium ^ £> : »~ : • 
such as a magnetic-optical disk storage device' may beye& % . 
used, or a remote file, made accessible via a communi-; v^ 
cation network '(LAN *or ^a" network :usingran RS-232C- -5 
interface) maybeused^ bsfcumop or: ffts noiJft'n-.osm 

Operation of ah' embodiment of the: present inven : ::C- s 
tion thus configured will now be described/ io^ns .-f»i inoaeiQ sr 

First-of all^i in ■•• response to a < command Ifrom* tiie noj.- 
mouse (or . keyboard)h'509;;a*videb= signal 1 which^is-a/orr. srfi 
video image information. source \s outputted from video" oO^a 
tape mounted on the .VTR 505.iVia the video interface r.oiinrr. 
504:ard the bus; 51 Or image: information: according toin - ' 
the video- signal is; registered: in the magnetic* storage:* : 3; iris 
device 506.^0;? jjjo C-i>^'i nc-iJfsrmcrni - -.;*oiq pnfva:n bofrfssrr.r^ 

According 'to the j video * signal : outputted « from - the 9 p v: ,? 
VTR 505 at this time.H image information of ?each frame -• .:>.-* 
unit is supplied to the scene change point detector. 503:' ; hr-fi-'t-.'. 
In the scene change point detector 503. the image infor- ; ; .5;/.: s 
ma tion is encoded and scene change points in trie 
encoded image information* are rdetec^edl) li^rmatibn -"*?t'-; ; . 
concerning the scene change points is also registered 
in the magnetic. storage. device 506/or L : :■ ^ : r -- & ! ^ " 

As a cresult'./ image uhformation including^ a . frame 
number corresponding to a frame of a. scene-change: 
point of, a detected scene change, a contracted picture 
for high speed display and a file name in which the pic- ^ 
ture has been filed, and a compressed picture and a file 
name in which the picture has been filed is stored in the 
magnetic storage device 506. .i ^ i^.LO >&j-\s y- :;i s> O - 

In other words,. the video signal outputted from the? <i- 
VTR 505 is subjected to data compression in the com- ^ 
pressor/expander^51 1*j and:- the compressed picture * 
data are also registered in the magnetic storage device.' 
506. ".-.>«-:•;:,' • . 3 *c C .rrirj -r* 

The contracted pictures: for high speed display are ' 
provided so f as to be read out at high speed from the: 
magnetic storage device 506 when .contents of the 
whole of moving images formed by a plurality of : frames : . 
or a scene are to be confirmed or the result of editing is ' 
to be confirmed. When the video signal- is outputted -. 
from the VTR;505, the contracted pictures for high' 
speed display are also generated on the basis of the 
video signal under the control of the CPU 501 and reg- 
istered in the magnetic storage device 506i »* c : 

The "contracted pictures for high speed display" are - 
pictures contracted in picture si2e and reduced in . 
number of pixels as compared with the original pictures 
in order to display a large number of cut pictures repre- 
sentative of each scene, on the screen of the monitor 
508 immediately in response to editing manipulation. In 
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the editing system of the present invention,- both a mate- y K | : { yfr..CPU whether; the scene; change point .detected , by, the, . • 
rial picture to b ^edited and a picture completed in edjt-itc . .3 T scene change point detector SQS.is^properj forthe con-, r- •. 
ing are displayed, on a single screen sub^ ^r, tents oyhe jmage ar^ .. 

instant jn^e^TOe.jto auser/s ax/gfgj^^^ mouse f^bc«rdi^9. iPui j r;u 4s !?oiito^5<n *rtf nrou • 

pose, the information^ 5j . c : The.vCPLl;5pi provides, each ^ p^cutsrjudged^tbe 00 :■• 

pixels qrjhe^ ;V proper as : a scene j^angeppimjcrf « • 

picture inforn^tiontis^ toini^ed. outjby. a P^eter^ pnsvofc. , r ... 

anx^.^i^thgjnfo ^HJP. e /if\^M?Mi s ?- a Sj^ wise W in^ge^edhinV:.©^ - 

to allow high^spe^ ; operator, via, the, mpyse/or teyboard)£09; treejStrudure . 

device 506. tn addition^the size^f.the cut picture iscon^., Wy rranagementjinforrration.as shown in;FIGS:?Z>and 8/&wim» 
traded so tthat^the dis^la^; screen^ of. Jthe »■ read out frpmtthe: magnetic storage. devjce 506 or the » =5 

accomrr^ateju:^ , H .^menTory/.502',jo toe r h:o erU to Jwoseni ofhsuso ^o: brie'cr.-*-;, 

way, contraded^pic^res.for J^^S^^^Ja^gijB^^ oc ?;r, v FIGr.ao- represents;* frame; picturesv(frame.J.mages)fj a >nc . 
pared be|oretend : . A/ 3Jne, j contracted . pictures n for r high:.. ^ f . ; y forming; moving; pictures record ed ;in the .magnetic stor,- ^ £ ^ : • 
speed display, a£&erop>cjEg^^ con ?0 ys ^-age devjce/^l>y?usii^^ lathe .u ^ r. 

ducting processing: for reducing ^^gM^Jm^ujiig ^ ™ systemlof tfhe;*pr.esent;emb^ 

of the origjnajtgicjur^e ii^magwi^ofjV^riqus Y&eo^y^^ structure- isvdisplayed onithe-rnonitor>s<?een.rJbeiterm?5 r 
terns sud^i^-me jfTSg sys1^^;the % ^L systeip.^.. ^^tfcur is;> defined tl as.t;at? f set« ofo frame) pictuces^:(frame>b *y£. 

When, it* is;,desired jtocConfirmjtheccootentSKpf i Jheos vnk images) .-sbot:jb#.asli& camera from the-start; of •a i shoot-3cr. 
above described scene, the. pictures for? Ngh^speed; disbar 20 ing operation until the. end. thereof.* A. ~scen.e7*is. formed*^ 
play thusxqntraded; are; used jtordjsplayc-thecdesired^v.s vby a set;pf apIuraJity:of.cuts.obtained;byvsr^ting.a.cer-r{:c 
scene on a high-speed display; window LSO^iShcw.in.ijr K.;tain fixed shoot subjed. Furthermore. Laipluraljty. ofjibhri^ 
FIG. 6 in response^ a^command using the; mouse (orjqi \ scenes ? cani be cojlededbj by i;a< specif ic.ishpotcthemen;-; 
keyboard) 509. q osbK :;o?rb gn^nco oi I" £>R ni nwy; .Video sources<can be anangedras-a. hierarchical: struc T ; e. i 

The.window^display^of: FIG:r.6iis displayed on the:x 7 25-q .ture: including: a plurality, of; cuts> a scene having aicoL-.- 
screen of the monitor 508 before, the effects editing s v"\ 
according tOithejembodiment of;the present invention js'u * or a title having a collection of a 'certain >:numbercof-.rr! ; >;,:•; 
5tarted. c -.->-.itc-a bnooec erfc n ;>^ic-5 VB. 5 ;|3tb iieeqa rigjr v_- scenes. Eacfcof; cuts; and -scenes ^is, provided with a spe-3^ 

For : taking put -a predetermined frame rpidureifromn. 1 * -o-cific number.^:}oic ^!tf r.»2 vd b3^^f:3!i>e^o , '. ^5 nofeefp-oto :r-. -r- 
pidure data subjededito data compression, ,it;is;neces-?c 30- .: - . FIG;c.1 0 shows an .example of a treelike hierarchical r. t 
sary to ; conduct .expansion { processing as * is. generally ,u r i structure of, recorded video:sources;tlt :is now.assumedr. (.jo c 
known. Jf> the cpmpressor/expanderj is* not-: present as>t ? ,ir. that the:srx>Qtttheme is,.tor ; .e^ar^ 

hareiwarerthecefqre,r.it?is necessary,.fortthe : GPU;.50.1 vsiiqstf.the recorded. video spprces^ra cut:1 obtained byjshoot-^: .: 
and the^ epmpressor/expander 51 1 .to condud pictures t :? ( 2 ! ing fish in the sea around; an island, a cut 2 obtained by « 
processing and teffed tthe; compression ? by : using;- the ; o 35- shooting a^ coastal i landscape?; ra^'cuti/ 3^ obtained. ;by> 
algorithm.of the ;JPEf3 system.- for example.; In the, case:*. ^ shooting-birds* inhabiting; afforest; and : a cutl4'bbtained;r :j . 
of data compression/expansion; processing .using - soft- 3 r ! J > by shooting a f lowen a re; included . VFhe cut \1 is formed by « -.oi • 
ware, a long processing time. is needed^rs^ • J ; noot '.: ^ -1st through:90th framesrandthe cut 2 is formed by. 91 stir- - m 

In this ernbc<Jimerrt;,contraded pidure data for high:;. ;; • . through 150th frames. Video pidures of the cut 1 and iv-' 
speed display ; ace - recorded cin < the ■ magnetic^storage?: ;4o the cut 2: are colleded ,as <a : scene-1: having : images:oi * 
device 506cKbeforehando ::Even r: rf ; cjthe:>iCpmprest:Mr = : . the sea ras.the shooting: subjed. yThe:cut.3 and,the.cut 4 v 
sor/expander-ffom conducting the 1 ., compression/expan-: ; are colleded; as. a : scene: 2- having.-images. of; the forests "... 
sion processing*. atr.highr speed -A$ :i not present casv -; + as the shooting subjed© juiuwus sa*; erw (v bs^.ty/X :o?-. 
hardware, therefore, thecontraded pidure data.for.high* In the;. 1 editing ^apparatus according toan; embodi- ' ()'■ 

speed display can be read out without requiring -the \45jv : ment of: the, present ^invention;..a representative .frame. •■ 
processing time for expansion/ In.other words|< expanr included in. framesi.fdrming each. cut. and a? f rame.of:a 
sion processing is. unnecessary in the case .where the ■ representative ? cutUncluded-.in. cuts .forming .each scene. » -» i 
contraded pidure. for high speed d'rsp lay ; are ; repro-ur are displayed on the screenjof the above described.hier- - v '■■ 
duced. .^ r-oH: :.sr :■. -=o v. archical strudure as contraded pidures for high speed -:vr • 

If the operator/ commands 4 readout; of:.the picture- r so display. be ->o Mtss*? £* -^c 1 : ? " 

information; for ; high speed r display: registered-- in the ' ■:. In the embodiment of. the present. invention^ editing.; 

magnetic storage device. 506 by using the mouse (or.% ; can be simply conduded by. altering the original hierar* :- * 
keyboard) 509, the CPU 501 reads out only first frames chical structure "displayed'- on cthe < screen- by. simple 
of respedive cuts, representing scene change points of • manipulations For s example.* ; *rtc; is k possible to condud >< 
pidures. On a display screen 600 of the monitor. 508. a 1 -55 . alteration (editing) so as to generate such a hierarchical, — 
window 603 for taking a look at cuts as shown in. FIG. 6 . structure that the cut 1 and the cut 3 have been altered c - - v 
is thus displayed.- * - :« c-.r • , i l >_;- :o. ' • to a new scene Vhaving animals. inhabiting.the island as-. - 

With resped to this display, the operator informs the the shooting subjed. In the editing using thevscreeri of ■ 
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the hierarchical '^ucturep it is v possiWe r tb feplace^or * O^-.Z display coordinates of the icwJTVs ^c^ln FlGJ*12;the"- :l - :1J 
erase cuts; 6t add different cuts? jrsyq sp-isito ? ~ : ^ tree structure shown in FIG. 6 is thus cfisplayed in the- ' 

As'fo>~the-met^ ' : ' tree structure display ' window 601 bf the monitor 508! * F>' 

editing using the hierarchical structure, those disclosed r • - ' T Subsequently; lra^n"s1tlon r t6 the* effect irnage editing r ■ '■' ' 
in co-pehding CU.SP- 1 ' 'patent ^application*' Serial "'No: 1 5 such as the wipeVnd dissolve is : cor^ r f1: : ' ' 

08/826.975 filed on April 9- 1997 titled '"Method of Edit- 'r^c | n the'OTnfigurafo 

ing Moving Image and 'Apparatus^of • Editing the Same-* s *L f display fof'SfeH' image' etfffing' shown in" F\<S} 'i Is first * 
can be usedih^he "embodiment of the' present invention:- »• obtained by ? selecting ah* icon 610^6? 161T 'representing , * 1 

For example;' in the case -where management'infor-- > ' : " t: i the start- of the Wipe ; 6perafcon- function^ out "of icon fig 
mation correspondihglo the tree structure' as shown iftznoy ures arranged oh 1 the left 'sicieofPKS'feP 0 ^ 1 ^ rJ ?JSz ' v ' 
FIG. 10 has 6een- read- out- it is now assumed "that a-s ' ^ ' The 'tnee^slhjcl^ 
command for causing images of the cut 1 and cuf 2-to o^iv been described? T ln-suc^ssibn; r lH 

compose' the scene i'isT inputted by the operator: Then;- ' will be continued bn this* assum^i'onV *' iJA ' 
image data having* the 'data structure shown, in FIG:' 7e' ur that the"cut 1 and "the cut £"qf : FiG>1 0 have Been "inctP 1 •*" 
and the tree structure^ rharagement "information having^ts v'cated bythe operator as the sub)ect*6f the effect editing:' *- A *w- 
the dattfstnjctureshown.in FIG>8/Corresponding to ihe ?ri ***fc , /"On the basisof ^ cbordirates'of the'twaciite if3j6afii3'"By^ nII " L ^ 
cut 1 ahd^the cut 2 'areTead but from the magnetic"stor- ^ou .^the operator wtth^he^'mouse' 50 Rri} %Cf 

age device '506 >by the CPU 50 T. In addition. *a picture; "Sue display windbw ? 60*1 sKown-in FW3S?S arS r 12?icon 2 cfis lir; :ff 9: 
number' servirig?as r a parenf*«iri the tree structure ; man : ^cs^^5play cooixiihates'^O^stored* ih -the' hierarcNcal (tree)~'' v 
agemeht information- is? set tb^T; 'arid values "1" and "2"> -20c n structure ^^mariagemeht^' information^ of^FIG^8 : "are s 
are set in addresses of; cut numbers' 1 - arid 2 serving as r v referred to" *ahd • i riforrhation "storing the 5 corresponding ■ 1 >J- « n 
"childreV^re^ec^ely^iorniailh:.'-, .fc-&'c:je Jck^h r>ey'» r. i cut numbers iVrespectrvely searched: bgaqe- rigid a ■:, 

Furthermorep display ^coordinatesv where icons of ae ne- Upon this indication ^manipulation/* a^'Mhdbw>1 01 £" * • 
these two cuts are displayed are calculated.' The calcu- o«: >;v shown in FIG. 1 for creating an effect video pictured 
lated values are set as cut icon display; coordinates of: "25 : opened oh the screen of the mohitdr 508 (step 901 in a 
FIG. 8;3 respe'ctiv'eryjs The* tree: structure.' management - flow chart mentioned later)? 'OUa 805 x>:mom rr 
information is reregistered."? to no-Joe'to? s univ^rt \c Subsequently,; a : ^ 

As fotf a" scene 2'aS" well; 1 -tree ^structure" manage-^ l -'"""-:fbr high speed display stored in the second address--'-' 
ment information is reregistered by similar processingrr-.r : .n! from theaddress" 62 1**01 the information (Fig? 8) storing - ^ 

In th e case where' the: theme- 1 generally formed bp 1 r 30 each of the: searchedcut numbers' is'read'butr idu? & r b - 
a plurality of scenesinbludes the scene ^il and the scene" Furthermore,. in accordance: with rthe frame interval rt; X 

2 as sh'own"' in^FIGPi O^the- treerstructure managements^ »v -value for readingtthe*contracted'picture"for< high speed km ■ • 
information^ iSiCread dut:* from v the magneticr storage ' display prepared beforehand on: the memory>502 (Rg?^-' ^ 
device 506/, Values "1"and "2" are registered in the area rir- 1 1»'»13). the contracted pictures for high speed display 1 are 1 f 
of the CHILD SCENE NUMBERS^ and 2i In the area of- -135'^ read out from the, magnetic storage" device 506? The > 
the PICTURE<NUMBE Ri of thev management informal 00c ^ contracted: pictures for^high speedrdisplay^bf the cut 1 • J ? \ : ; 
tion having the scene number equal to the value *1" and o ? and the cut 2 are displayed in the window 101 shown in - ? j : 
the value "2> ^"-ithe value ' "theme :1" is respectively regis- j •: FIG. 1 as icon streams (image^streams) M02 -and ,103 ' - 
tered. t»r ; s r iuc- g»'U io eeiuJt'iq csb : V .ssm^i '305f r.; : . ^forming film images similar to' framed photograph. 7 ^ ; 

Subsequently; the' operator manipulates the mouse )* 40~ :* • It is now.assumed that at this time-2" has been set r 
(or keyboard) 509' and : thereby issues? a^ command thatcv : l by a slider 107'(Fig..1) beforehand as the value specify- 
icons others than 4 icons located in the'lowest layer should i 0: ing the frame interval: Then the frame numbers read out-- - ! 
not be displayed in the tree structure display window ^ as the ^contracted pictures"- forr- high speed - display ' 
601. Upk>n^this^commahd-c the hierarchicalvstructure become '1; 3. 5. In other words; readout is performed 
management information; is* read out from the magnetic'- 45 every other frames '.r !»o 1 90 {K^ ^.» ' 
storage device 506 or the memory 502: A display iden->>: 1 : Since at this time the contracted pictures are used ^ 
trfier indcating that the icons should not be displayed in . for thee high : speed ' display in this embodiment as^ 
the tree structure olsplay window 601 isaddedtoprede-i:? !*■ - described above.* the processing time required for the r ' 
termined management information, and resultant infor-: ■ display becomes shorter. 

mation is reregistered. ^.50^ - In a region located under the icon streams 102 and 

As a result.' the CPU 501: discriminates this display 103. a film image synthesized from these two kinds film ' 
identifier;* recalculates- the display position. - and .con- i*i ".r. images by using the effect video processing is displayed 
ducts the display on the monitor 508: As for the display 'k ; as an icon train 104:*'*^ riK - i C-i f J r: 'S> v- • " ' 
at this time, therefore; the cuts 3 and 4* supplied with the r# In FIG. T> the film image 104 synthesized. by- the " 

display ; identifiers preventing * the ; display are not dis- ^55 scene transition of the dissolve effect is shown. ~- . r - 
played as shown in FIG. 11.-.*. fc; r iu*. ^ •'!*''•• -if*, ;-- In this' embodiment, therefore, the icon streams 102 
By successively repeating this manipulation, there- and 103 formed by film images similar to framed photo- 
fore, the CPU 501 conducts processing on the basis of " graph are displayed as pseudo-pictures representing " 
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the roll A and theTOlls B. - As'pseudo^p.ictures represent--. o can be: displayed.'- For~ example^a pattern: 1 1 0a is ■ an : 
ing the role A*B synthesized by the dissolve editing, the" / , 3f-:. , ioon for a horizontal slide wipe effect wherein a pictures *?• V 
icon streams *104: formed by the film : image similar to <rof B role slides.from the leftside over.a picture of A role >% 
framed photograph" is displayed.-Trius* the' editing' work \ ~. '■' h t thereby.switching over the A.role to B rol e. A J * Vv\ n o r)r. •; 
of the role A+B can be conducted easily^? V:xssto*c wc&s yx\ ^ ^jsic embodiment, -therefore, ! various - |T data- *H** 

Underahe icon : streams- 102,* 1 03- and j 10~4>iruthe required^for effect video. editing* such as -wipe andsdis-' f 1 
window 1 01 *• a window ii 05 is set as an-"effect time set- ! m .v solve are:displayed : as~ pictures. Furthermore, required^ ■ " 1 
ting areaxln -the; windows 05.* rectangular figures, (slid 1 ' input prcrcessing'can Be selected almoston the picture.- ^- ,r 
ers) ISO^arKlwisiJnlselected^ andeimov'ecf by'-' the? ^ r '•' ofThus the worRcan be acrvanced"effidei^y.^K>' 
manipulation of the mouse 509 are displayed. * The; & w i* By : referring- to; a flbw.^ 

length of these- reclahgu^ ;A the window 101. conducted by the CPU 50f will now be) v 

lateral direction on the' screen represents: thenumber*dfc -described!**^ \vob.';iw t>3?& Kbs^e ;c* r4so 0ft c;s,v t;. * 
frames of the T scene (cul^and cut 2 at this time)i^ s .ore: js;? The^windbWTi01? is controlled by using afpfedet4r- • 

TherefbreT the effect time setting can be grasped as^^ -v mined program 'stored iri*.the''mefnbry:-502i"FlGn 9 is* a & 
overlap ?of th ese r r ectangular f igures i 3l 50 andid 51 ■ "By 1 ri flow chart showing the control processing of the window .& 2 
moving these figures 150 and 151 with the mouse 5091^ 101 conducted by this r>ogramr° -C- J r, „WAfii;-??. > : 
their lengths-' and 'overlap nen^K*'a*e"' "written into tth'e *A The processing^ FIG? 9-is ''started' Deselecting a*^ 

memory 502. ^As'a'result^the effect time* is set?'! nsso r^-i VO i^ipe~610 out.oi"^ side"' " 

A white area of a bar f igure«1 06 in; Fig? V indicates^ 5»irof FIG. 1 2 with the;mou'se 509 as'describe^ 'a'bov'ei-Rrst^ 
the overall len^r(tim'e} of air images forming the cut 1 -aK^of -"all, f 0 initialization pnfoH^ making ->''ab-o variable^ 
and thetcut 2 selected, as the" editing subject J A hatched ,, REDFlAW : LFfc"AG">s^^^^ 

rectangle 1 06a located 'at ^ hear the central:* part; of the n is >n-*tfO" is ■conducted^ at>= step^^900.s ^The^^variableV^; 
bar figure' 106?irtficatesrtheMime*:^ 

tractedpidure'strearrfe r 1'02 and=103 of the cut* 1. arid cut^fi^'^cpfay processing of the'' icon streams 1 02**1 03 r and -1 0'4? v 
2 of the i: cu>rently' v (displayed? refgibh* and- the'- t emporal -< 5 ! 25* ^should be*ebnducted.s !i ■ < - s^^oc^. ns.?-.:^ -:- : *t* no e • . 
position of the displayed image in all' of the images/ p * ' •*' Subsequently at step 901. processing for displaying-^ 

By manipulating th'e'rnouse, tne'rectahgle 1 06a can 1 ^ the window, i 01- -{F IGT-' 1 ) ■ on r the : rti6nrttfr-508 : is« cdn^of 
be moved. According to the moved position, film images'*** ducted. - 'i]ji:Oi^: ' s-^i?;-. ro ' 

of the place to be ootif irmed; of each scerie'bf the effect 1 At this time; 1 -the ; window h 01 'shown : in- FiG^ T : is' ! & 
portion are displayed'as the icon streams 102, ! 103 and '''30 '^ -opened as to be displayed on theAscreen 600 of the !'--• : 
104. .b«*lJ?:n»; ^:;'' 'monitor:5d8.^ /1 > v z&s' ^-'f'.o^-c' Hl&qi 5<jZ os = 

The- position^ blithe rectangle 106a rridved'by^trie - Subsequently -at- stej3^902 i ^^ 1 interrupt^' inputs the 

mouse 509 at this 1 time 1 is also' writtertfinto** the" j memory rt ~. r . ■ u processing is conducted? and the processing- proceeds •"- ' 
502. As'aVesult,'the film images displayed 6ri : the icbh^ ' -" to steps 903. : v - - &>'.'• ■ '• 

trains 102M03'arid 104 r aTre T set" - jovs 5--»vi9ri-0 35 - r. - An interrupt caused by manipulating the mouse 509 

As the setting area for displaying the picture data ■'■'occurs when His button is turned OFF 'from ON "as" well " 
for high'speed'display'oh the film images " witff an arbi- ' as when its button is turned DN from OFF At the step-**'"' 1 - 
trary reduced scaleVi.e.^as the r settihg area for display-'V^' ^ 902. however/ it is determined thata'rT effective interrupt ,;, '- ?; !: 
ing the picture data for high speed display with a fixed'-'** "■' has be6h conduced when the button of the mouse 509 
frame interval, an icon of a film image icon stream dis- - to ' \s changed from OFF- to ONi- At this' time, position coor- 
play interval setting slider 1 07 is set. In the slider 107>as-' dinates of the pointer moved with the mouse 509 oh the ; 
well, a • rectangle" r 1 07a " moved- by- manipulatirig' : « : the"' : screen are inputted.- • ' " >- •• f >o 2 • • - ^ '•' * s 

mouse is displayed. At this time? the set numerical value ^ At steps 903 through 908, ; the position cooidinates" - 

is also displayed simultaneously" within the rectarigl e " of the pointer are compared with areas of various sliders' 
107a as illustrated: M\'&C" \<w.v\ vKjivxam -t. 45 '--and buttohs'and-a' wijSe'lpa'tt efh ma'rk'bf the' window -101- : 

In this embodiment;* an OK button 108 arid a cancel -shown in FIG. 1. Thereby, it is determined which event, 
button 109' for' icons 'are set. ByWa^ipulating a pointer* sr - i.e., which setting 'alteration arid -alteration quantity or 
on the saeen with the mouse 509 arid selecting the OK 1 ,: value has been' specified by the inter rupt* at this time. - : 
button 108,'* the operator caii terminate the editing. By r :: At this' timeV an intenupt'conducted at a meaning- • 

selecting the* cancel button' 109; the operator "can aban- 'so less place is disregarded. If an effective' interrupt is not ;t,> f 
don the processing [on the way. r? ' '■••*^-' Y«-'» rr: "> : >"^ 

Furthermore. 'in ^ r *--- 13 ■ : " ' 

wipe patterns and dissolve patterns; and an icon-area" If ah event has occurred"b'y :r poirrtihg usinig the 

1 10 for displaying other effect video processing by usihg : " pointer and an interrupt using the button of the mouse 
figures are set: The ! operator selects r a figure** (icon) - 55 ' J 509 at the stej3*s"903 through 908, r th : e processing pro- 
within this area 110 with the mouse 509! Thereby" a syh :> * :< ~ ceeds to execution of each of processing* 911' through 
thetic pattern of film images corresponding to' the effect 918 corresponding to that event. The processing 911 ■ 
video prbcessiriig indicated by the selected figure (icon)' through 918 will be described later. - 
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After t such processing has been finished.- the.step: a • ^:to "1" and .the processing proceeds to step 9.16. "At. the vq* 
909 is executed. riw ''iz'rz- -?r-!»v l.~nor <r~ sr* ■ step 91 6;- a, numerical value specified by the mouse 509 ' .'.! 

At the step; 909; H is determined whether the'varia 1 ^ ' c»s written into, an address of a f8m image: iconrstream \z 
ble RED R AVV_FLAG 1 c is^ .'1 $ rvUnJessv the>" Variable i-rioijii. display, irtervaln number,. of . the.:memory^502?and:the! • • ■ 
REDRAW£FLAGv.iSA"1,^ .the: scene transition^ editing processing proceeds to the step 909. oz- -r : : i 'v. 
such as thei wipe .^interpreted- as. not commanded; byo - At step. 908:^ it is determined whether: the.wipe pat;- . 
the user\andxa return to the step:.900:iiS;;cpnducted:G extern mark; 1.10. has, been pressed. clfj the:.wipe pattern.-, 
Thereafter.,- the variable REPRAW_FL^G .turning;'Lir. is'; - t. ! mark 110; has been pressed^the/processing proceeds* 
waited for in the loop.of thesteps;900 through 909.-;*v $&> auif to the step 917. Otherwise, the: processing proceeds to ; 

WhenJhe;\ranabJ.e v REDRAW^FLAGisiudged tobev^ the step 907. bsvsiqssb g\v SOc seuom o«1j to nrafiV »••■•- 
"1" at the step; 909.cttie; processing, proceeds; to step-A- si: At the step 91 7. the^riable^REDBAW^LACaisset 
910. At step 910. data for special effect window setting^-. ;>.?3:. to "1" and;the. processing proceedsjo. step 918..Atthe r. --Vj 
are read frpmtthej memory 502; and processing for . dis- step 91 8. a numerical; value; specif ied by. the mouse 509 c - rr 
playing the icon streams - 102 i~ 103; and .104 of thejilm i>s* sris written; irrto ; an.; address of;a,vWpe patter nvnumber;ofi;: 
images in the. window jl 0.1 Js. conducted: Jhereafter.-.the.rlo'Sr^ the* memory i.502> andi.the2 processing; proceeds. to the - r.r : 
variable R ED RAW_FLAG is reset. .and; returned; to.. O.-.u; ; 0-step9O9x>e Ocvsm erii nuw rer br.z 0c? ■••.;c;ii wart? y. -iv 
and the.prpcessjng;returns;to.the step 900:* ifseoocrq S';7 At step 907. rtjs determinediwhetherithe OK buttorir:! v 

Therefore;, processing of steps, 900;throughj910 is T:'^\V 108 has been pressed.. If, the-QK ] button st08 has. been iotr 
repeat ed urrtiUhe.end of the processing being able to be .OF '-pressed.* the processing proceedsjo the step 919; Qth-. > 
executed in^accordance^with.displaying of; window >101. .in 20 • erwise, the, processing proceeds to. the step, 908- si llfiisvci 

Individual processing of steps 903 thr.ough.908 cor- l i : " At the step 919, Jfie; overlap.quantity_*and -the^wipea n: : 
responding, torespective events will now be described. 0 pattern .nurrtoerijead^om a >predeterMQed_nurrtoer ofcr.i-M 

If a decision result atany one;of. steps 903 through ^c^^^^ the,-:*: 
906 has v becomei"yesv;as a result of selection .withsthe. -q y^u pertinent cut nuniber k of the memoryi5p2,are.writtenJntq r . t-. 
pointer on the screen responsive to the; mouse,: then #25,*: -the: hierarchical structure management: Information file.; 1 
data for^f executing?/ processing, corresponding -to.; the of FIG. 8, and. the processing proceeds to step .920? -c *>c \- 
selected , event are-written; into the memory ■ 502: by . th e i t 7 . . At step .920 : processing* for. closing .the r window : 1 0 1. < ? 
CPU 501 at steps 91 1 through 919. ,-'?.-,-.;t.is conducted?-:; c-\\\\ .noiiiaoq b&vorn erit ct D/iibioo^A .bsvo: 

Various sliders and.buttons displayed on the screen \* Thereafter.iavreturn.toijhe originals display^ screen:? 

are associated wfth !interrupt ; eyerrts.beforehand. rx 3Q*.k shown in 'FIG;- 12 Js effected, .and Jhe : effect = editing, is r c 0 

At step 903. the result becomes "yes" wheaJheio;inc>-; once finished, 
overlap quantity \ setting : slider ,1 05 v has been ■ pressed^ At step , 908;, it. is determined; jwhether ic the- cancel, 

i.a, the ? slider -t05 has. been pointed. .Otherwise, the 1-53 > .button 109; has been pressed: If . tfie cancej button 109 351.. 
processing proceeds to the step 904. ? :.e n:*. : has been pressed; the. processing proceeds tqlhe step^ • 

If the ? .result^ ri .is :o "yes. ?uv then; ;? the -.. ;variable 35 920: Otherwise, the processing. proceeds jo .the step 
REDRAVvlFL^rjSfSetito;"i;iat,'the .step^9J:1 Land: .the a. 909. zu^q ex* j}-ivE::.p^ -.i? i;fr-MS. ^rb • 

processing^.proceeds - to step 912 r, At : th e step ; 9 1 2;. a ... - - , : - At this : time/; therefere.i the hie rarchica| ; • structure v 
numerical value inputted according to the point position^ .:o rnanagementiinformatic<i..T^^^ . 
specified by .the, mouse; 50^. is^_writtenJn.thea<Wre^ Pfe^ri processing ;;isj f inished^i while > maintaining the , original t 
the overlap, quantity .of ..the : memory..; 502;;. and: t the : - H -f0 . information. ;nas«.: nc:». '-gnm :ni . r »o r>c:i if.vu>:ri 
processing proceeds tq-step.909. be'.w. ~.n;f;oo f..r-1 : : r~;r? The. editing processing program represented. by.the . 

At step 904, it is determined wh ether ; the^display . vr :flow chart shown in FIG. 9 is stored, in the memory ; 502 . 
position: sett Ing ^slider r ;106. has been- pressed. If Jhe ; . in a code signal form which can bevread by^ the. CPU 0. 
slider 106 has been pressed, the processing proceeds. . * 501 . The memory 502 may be a recording medium such . 
to the step 9 13.. Otherwise, the processing proceeds : to .< 45 as a semiconductor memory, a CD-ROM. a. magnetic • 
the step 905.- .-bf w < \ 'vn o v " v:i •"" • r *■ 1 ' . .-. ■ r disk or an, .opticaJ>diskoThe editing processing program 

At the step.91 3.- the variable REDI^W_FLAG is set . of the embodiment pi tf>e presert inyentipn. represented 
to "1" and the processing. proceeds to..step 914. At the by FIG 9 may be installed; in a user^s general-purpose -i 
step 914j a numerical value.specrfied by the rnouse 509 . computer in . such a-. form, as to be stored, in ..such a 
is written, into an address of a f ilm image, dispj ay start . , .so* c recording medium. Alternatively,, the editing processing 
frame number.-qf the. memory. 502 and the processing v.. .program may be stored in an external; storage device.- r . 
proceeds to the step 909. >> . ^ ^ r .* ■< ~ :< . :; 7£? y v located in a remote place arKJ.ctownlpad.ed to the mem- . 

At step 905. it is determined whether the f Dm image ; ory 502 via.a communication Ijne.j ; \ - £ v ; , : < l{ . .• ;fi ,v J ; 
icon stream display interval setting slider ;107.has been - ■ In the embodiment of the present invention hereto- 
pressed. Jf the, slider d07. has , been pressed, the . 55 .-fore described, each scene to be edited and the picture 
processing prpceedS/to. the step 915.. Otherwise, the . :>v . subjected to Jhe i effect processing such as .the wipe can 
processing proceeds to the. step 906. • • • >v - ■ be simultaneously displayed at the time of video editing 

At the step 91 5, the variable RED. RAW_FLAG is set using the scene transition such as the wipe. I" the same 
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way as the case using the moving picture display/.therefi-l'i memory ^502; the mouse or- keyboard '509;-: the 1 .video* ■ 
fore, it is possible to make the most of the. advantages of oso interface :512, the^ picture, compressor/expander.: 51 13 \ *'T 
the direct, scheme: and. conduct -various- effect* editing ?fif e:and theaudio interface.512 are connected to a bus 510.. < • 
manipulations including the AB role editing refficiently,; ikiz* and controlled by an access signals supplied J from the r -rvjo. 
and easijy.-** ^.-'C^ Juu-tio lyr.ucs Sfw .br*r« ' ^fo ?d' .'»f5 CPU 501 avt i ; -'^^>v; e^l to ?r*rn^:.oVtt5 on r.i i-t.?>;av.» .f 

Furthermore?^ in i thei:embodiment (6f "the* present' bnvub Instead of the magnetic: storage' device 506,ta l dif- • - / 
invention. Lit vis? notanecessaryitor use^ hardware ? fon. ^c-i- ferent storage medium' such? as an optical magnetic 
processing such as the wipe bf;cOTpression/expansion;r' storage (device may be used; Or- a remote file connected . o ' 
processing of pictures.';Therefore; rt.ispossible to.suffkwlT to the bus 510 via a network may be used. 1 -** - yrii .;o >; v j -cv 
ciently suppress the cost increase and the size increase \oio -:*b : On,the' basis of .the scene 1 change point' detection 
of the apparatus, vd 202 to:vab spams oUaftssm on/ n- b.-v: information detected by the scene change point ! detec-- 

An embodiment in which sound? ihtorrrrationMs **uo t tor 503^^ 
edited by ah: image inforTOtibn" editing r system accords »-„ scene or cut change' position: out of the movingpictures : •■ ■> no 
ing to the present invention win now be described bye; ^^:;;for high; speed dispIay^TheiCf^U 501; displays^ repress >o«v 
referringto drawing.*::' vab opc >oi? aitengem art! moil ^-?er 75or serrtative picture of a'scene or a'* cut to which that picture '-^roote 

F IGr 1 3 shows an example of an apparatus used for' s belongs: on' the T monrtoro 508: i asr- icon ' pictures * 1 302o *? * ; t« i 
such moving image:editihg/The same reference humeri: i-q a ^through 1304:iri:a tree^structure .^display windowt1301 '=?^< erij 
als as those of the system in FIG. r 5 basicallyrefer to like < s :^ : shown in FIGX141 The'term ricc<i"/refers"to a'smallpic-'Or. k-s 
componerTtsiOjinc*T! eri? no * wobniw nteirt >? ni h 4?>;t*ic?;?"b iv \ture or figure for the screen'display ::mahipulati6n3n3>5 i 

A scene change point detector 503 analyzes the-o 20 ;>^e': user;- (e^rting>;worker)rfendles^ pictures- dis--*^ ^:' 
change of color 1 distribution for each; frame < of moving o ! played on the screen of. the: monitor ?508 and shown: in'sp- 
pidures ahdi detects a scerie change point'whichrfe*a . -r? ivFIG. 14 as the subject of editihg T *mahipulatiori ( l and &Q r 
change point between cuts. A picture ^contractor > ^ : a 

(reducer) 513 thins out pixels of an original: image mate-v;^ archical &i structure ^ (tree* structure) f.^Thus *>ithe>user cii C 
rial and thereby creates moving pictures for high speed e rs advances the editings stS k& bsisvt?«n&tj hikicj f>c nuti 
display. A magnetic storage device 506 -stores the :rndv? ».».':;.; i 1 : As for the method and systemof the moving image' *: in *cvj 
ing pictures foro high sp eed: display : arid stores' moving ;iw , r/ editing using the hierarchical structure! those disclosed- 
picture analyzing information describing the^detection'ioiocc jn co-pending ; uU:S.^ patent-!- application n Serial" - Noi 1 
result supplied ifrom:the> detector 503- and the^movingKH 08/826.975 can be usedpu- 3fe?-^ni *f*? n. b?ic:- 3^ vi-(v:<::i 
pictures for high speed display. i i r • ; ; : ri u t of- q ;5 n»- v c erao r;» - In the tree structure of F !G. 1 4 . a picture located \if .*s • v ?q ) 

A monitor 508 displays th e moving pictures stored 3 1 r>. a middle d ass; for 'example, the picture 1 303 represents-' n 
in the magnetic storage device 506:oh the basis of the^ a plurality of^picturesc 1302 located in?the< lower dass» f ■ ;: 
analyzing > informatidn. f The monitor ? 508- also ^provides' *and belonging to the picture 1303 as~ohe group a^ 
the user with 5 an editing screen for implementing a GUI > • ^ responds to a^chapter:or section of a story.vSimilarly; the^ W 
(graphical user interface): By the GUI-the^ usetf ean con- ^ 35 picture 1304 located in the highest class represents, for 
duct various dattf input manipulations including selec=-t>— ' example^ a plurality of pictures 1 303 located in the lower' ---': : > • 
tion out ' of pr edeterrhined'display areas' displayed ■ in a >« ■ dass and corresponds to the whol e story.' £ 9 ns \o isjnc- 
picture conducted by manipulating an input device such*- According tb this methods editing can be conducted- • r-:«»-.v: 

as a mouse or a keyboard/ arid an output display corre^'-v*:' f by taking a scene or a cut as the unit. Therefore, assem- 
sponding to the ^^manipulation is conducted. ^iosib ? OS* * ^ Wing of 4he story is facilitated, in addition^ division^'of ; ' 1 

A frame buffer 507 stores images to be displayed • inputted moving images by taking a scene or a cut as-"'^ - 
on the monitor 5081: A main merriory^502 stores various* ' : the unit is conducted iri a nearly automatic mahner>As '/ ,v 
control prcrtjrams. Armotise ori keyboard . 509 is -a com- bs#j:ii-: a result, the user is hardly ^000166. ' In addition; it is pos- »>" iv 
mand input device of various bperations.r: r ' 0 • - sible to store and manage moving images in a-hterarchi- ">st 1' 

A video interface 504 is supplied with a video. signal \'4S ^ cal structure.^: This results^ inVan* advantage"- 5 that-- a 
fed from a VTR (video tape recorder) 505: and converts * : required: scene or cut can be searched for easily/ The " 
the video signal to a moving image format handled by > - burden oh the user in the moving image* editing can thus v - 
this apparatus^ A picture •compressor/expander 511 * ' - be lightened. • ■: 1 * ' . * r; - w&zsovy) ;.r.:f;o:>rr { ■ 
conducts data compression' on original video informa- '^n The editing system of the*"embbcliment shown in * *~'y~ 
tion and expands the compressed information/An audio i 5o FIG. 13 provides a moving image sound editing method r: 
interface 512 conducts conversion processing on sound"" ! fadlitating the editing work of sounds accbrnpahying the" 
signals so that the sound signals may be exchanged - L " r moving images, such as overlapi" editing or -mixing edit- vr 
between the \/TR 505"ahd a computer: A CPU 501 con-' ing, by manipulating icons on the'display screen, 
trols the above described components and manages In the sound editing according to the embodiment 1 : . v 

their operations. ; > ■■ - * ss'-- of FIG. 13. pictures of a portion of image information to - 

Together with the CPU 501 . the scene change point be edited are displayed as film images from the left to"- : ' 
detector 503;-' the magnetic storage device 506. the * the right on the display screen. By watching this film - - 
monitor 508. the frame buffer memory 507i the main image display, it becomes possible to associate picture - 
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information with,' sound I information. Since • the screen i<y i is- : The stored? encoded rnpyingrpictures are used ; in ma yaw 
display manipulation with GUI can be c nducted on cor^hen the case where high speeddisplay is not required* such :s . ro* 
responding portions .on-lateral bar-.f igures, r editing: of a?!; was the case:wher the»user desires to watch th finaln?t' art 
sound information: is facilitated;^, asioorr riG vc: b&itatf^oo in. result of editing in detail: sta> 8 A srt pr.iU:!:w>j enoi:sluqincni 

Operation in an embodiment of the present inveri-^ S' f -0 On the other hand, the sound output signal reprcP^- 
tion using, the, moving. image editing apparatus of FIGisr :i duced from the VTR 505 also becomes digrtized:sound!j 
13 will now be described by referring to FIGS: 13 ; and information via the audio interface : 512;and is stored inttnsvr.i 
15. In FIG: 15. an arrow; represents control processing^^^ pni-vGix: m 

conducted by the CPU.501og yam ihowtstn r, G: d*,ic erU cj Then t the;editing. worker; (operator) commands: rea-. ? aoi< v 

In response to.a command fed from the operator, via nOo dout of themoving pictures for high speed display regisf? virn.v : 
the mouse ;or keyboai^ .509.;the;picture.signal:an^ in the magnetic storage device 506 by using .thes i 

sound signal 'areoutputted from the. videoitape mounted tOZ k mouse of keyboard 5091xr^oa rtoiriw ni msrribwJ-TO r,A 
on the VTR;505r.and afprocess;for. registration of. the > soc^? In response tofthis-rthe .CRUc 501. reads out; thei te;irx- 
video signal) and.\thecSOund signal - into v the magneticriQir: scene analyzing information of the corresponding mov-jr o? onl 
storage device 506; is started,: At this time^ the mosnngsniisvz .ing image from the magnetic storage device 506. On theinrneta 1 
image olone frameunitiis supplied from the? VTR 505.tOfQnoir basis oMhafc information, .the GRUiSOIc reads. out onlyT^R 
the scene, change point. detector.503 via-the video: inter-ri^.vrifithe picture of the.only :firs1;'for : exa"mple;j;framp of; each*r. n^of: 
face 504;and.the,bus 5.10 (processing <70.1r of FIG.c'15).ni nwo.-1,scene from.the moyihg.pictures^fbr: high speed: display;^? as =jif. 

The scene/ change point.detector>503; digitizes this- x> c ^.and displays it in a main window 421 on the monitor 508ioamoo 
inputted movingipicture; ;analyzes the color distribution?^ 20 as shown in;FIGh16. 205 Tomteto mioq epr:fioo &r.s^s A 
information >\ between pictures, c and detects 1 a: scene b=? ys ;o Icons rsuch as ? moving picture display.oh the: main 9 ^r.*:, r. . 
change point (processing; 702)^ io Josmcu? ^rij zi> v\ Oi : window aMhis time become the subject of manipuIationBd v^, 

Moving image analyzing information (scene analyze in this embodiment. snufoin ? .aruo neswted n-.aq sonars 
ing information) • including ( v the ; frames numbefji.of the: Rair^.s The operator mahipulatesjcons on the monitor difiieoubs ;': 
scene change point generated by the scenecchange r;^/.; play .screen^and assemb|esrtr}emcinto.a>hierar<^icalb;,s 1 
point detector i503c is stored i in he iimagnetic.. storage e£ structure,(tree structure)rshown in the tree structure dis- 
device 506^ (processing 703).-H.n;e iBairtaisieiri &\) yuiau on byplay window.. 42 l^of FIGiiie^Thusr. the .moving image-on 

At the'same.time.smoying pictures; for;highr_speed:^o;: . according: to the;story is created: ncijr ? rrv«orni E-;*isv*r"; e v.-i-'o 
display are stored in the magnetic storage device. 506,3 ^mo Hereafter; a.concrete case. will. be described by. tak:;: lii.c-:--. 
(processing ,704)^ siurDiq e ,£i OH to eiuiw-'iie s^r; rso ing r the overlap editing for the treeistructure:shpwn.inrc-»:u:;MO 

The.^mpyingvpictyr.es/-,forKhigh .speed^displayiareijoD:;;] .FIG. 16:as:an. example, gnrvom em ayaterb 8*:€ wmofn A 
obtained-: by. conducting:: the i Contrac^^ prcKjessingir^u^ b The case where overlap;sound editing is conductedr: <jr.t r . 
(reduction; processing) (pressing ;705)(by, which the fez >; • between: a scene represented by an icon .422-(hereafterriv/:rf 
imaginably, same data as the moving images inputted to^o >referred to as scene A) and a scene. rep/esented by anec .i er'-* 
the scene-change point detectorr503r is- contracted ifbr ^^...jcon 425 (hereafter ^ referred to as: scene i.B) willinowibe^rk^tr. 
conducting various displays, according Ktp.;thes. environ^;. - n 1 consideredicTransition to.the edrting mode is conducted r,v ?:; •: 
mental size of the GUIoThe moving pictures ffornhigh-,/.; 5;.-; by clicking the icon : 422:and icon: 425 with, the. mouse run 
speed display become the subject of manipulation in the:o-V. 509 and thereafter clicking an overlap editing button . 427- e : 
present editing-apparatus, ^-.{ <-e luo s vj ?n«*5 .= pr:--^: v included; in a button: group; 426.;As J a:resuK,.an editing;.:; r . 

Forueturning) an-arbitrary image:- selected. .out of 40^.! v screen 420 is displayed. FIG. 17Ais an enlarged view.pl *.»;. 
encoded moving ima g es to a video signal and reproduc-:. l c r this screen, v:^ . ■ •.;» ^ o; ^ c u? ; c a 10 :s \ 0 1 j : • r • -tr :"■ 
ing the image,;.rt ; is necessary to decode ithe. encoded:; In ^K3:r,17A,. numerals 12l£and 122 denoteicon-, c 

moving images.rJn the.QRU 501; the processing time for ^ tracted .moving picture^streams&.(image streams) !; . ^ :• 
this decoding is required, pnw^n snufBrr' s*r/? - obtained by arranging and displaying the -.high -speed-; : t,- - 

In this ^embodiment, contracted pictures for; high : 45 c. display moving pictures of respective frames in a prede- ■ 
speed display ; : are - stored > beforehand as described. >> termined section of .moving pictures (hereafter referred 
above. Therefore, . decoding^ processing ( is. not^ oon- r - to as picture A and picture B) respectively. belonging to . 
ducted, and decoding processing time for that purpose the scene A and the scene B. from'the left to the right in 
becomes unnecessary. The overall processing time.can.r time series so as to form a film image^ecrv- . - : ;. 
be thus made shorter.? r.-r (ro • rrr-. h ?^tr.f\rr.:» v\goa- Numerals 123 .and 124 denote: waveform display-. ?: 

SimuHaneously, wrth_ the scene change point detec- jr o, portions of sounds corresponding to the scene A and ; ■ .r^v 
tion processing , (processing . 7Q2K and .storage of the c ? •» . >' the scene B (hereafter , referred > to . as . sound ■ A and s ( o c 
moving pictures for high speed display into the magnetic , ■- - sound B) The waveforms are read out from the storage , 
storage device. 506. (processing. 704), the. moving pic- device 506. At this time.- : a splicei position between «• . - . •.. 
tures are encoded injhe picture compressor 511 by ess. ■■. scenes is denoted by 125. . nvx>o 

using a. picture.; compression technique (processing. As for the display, the operator manipulates an icon ..; ' 

706) and the encoded moving pictures are stored in the 1 28 for setting an interval between adjacent frames of a - 
magnetic storage.device 506 (processing 707). displayed picture of an image stream (hereafter referred - 
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to as settingjcdn): As a result., contracted picturesarenT eral bcU-dispiay portion 126, the display position setting ■« re 
displayed every;preset number of frames: Furthermore;^- ^ ->ricon 127,-and the display, intervaLsetting-icon::128 are* 
by manipulating; a display i position setting: icon .127ri an :>; subjected to.display control so as.tobe mutually linked.: 
arbitrary section in the whole of. the image streams .121 o ;inv,The result of, manipulation is. immediately reflect ed:rn:V/ v. 
and 122 can be displayed. .i&jteeiaH 3&*srre ^s^*- .While watching the image "stream h21 and : 122-^ 

Indrdertb corkfuctthecverl^ "J ^resembling film images and.the;SOund waveforms, the? 

controlling and varying the sound volume so as to atten- *-J ^ operator conducts: the cbveriap' editing by: manipulating}!? . : 
uate the sound A arid augment the sound B. in and.near- A the lateral bars 1 26A;aixJ?126B5^ b:\ r It ••rtf'aao 3'ii : ' 4 
the splice position.>125»the,value.of the sound volumes • ~ , Another editing screent420 is: shoSvn in Fig.:17B! 
control level is set according to each sound information. :v70>; - In FIG.17Bs numerals ^121 andn122 denotexon^ :•; 
The CPU 501 reads out:sound information of rediting; is '1 ; traded Tmoving: picture? streams robtained' by •arranging;.*' 
subjects' of the' sound-A and the.sound B from.the 'mag v c and displaying me- high:speed.display . moving pictures r,^ 
netic storage device . 506? On the>. basis of .the sound, artf? of respective framesina predetermined section of mov- /a 
information thus£read :outKtheXF?U!t501' newlyc pictures (hereafter referred to as picture A and pic-^;? 

ates sound information attenuated: wth'predeterrrdned r: JSricture B) respectively belonging to sthe-scene A: and. the: « 'i 
attenuation . factors ; in the- editing 'subjects portion:; The >f ' scene B,v from the leftto the right in time series so as td ? i • 
CPU SOVrewrites the generated ?ni '^form a film imaged n! .81 .OH \o (a) nri oworfg sfi 

the magnetic storage device:506r«^H . tcte rsqc eft v J :-r :r. s The portions of dotted line of the contracted moving -.?r» 

As for the: manipulation function^ in Vthat case^ for ? ivi picrAires denote no eff id ent part^for the edited picturei ^ 
making possible trfe sound volume control by Selecting r?:20sr, . y Numerals v1 23 .and :124;denbte. waveform* display .cc 
the range;6f the editing ; subject portion of each - sound >: v portions; of sounds corresponding TtoxtheVscenejAvand S 
information -andjsettihg.ra predetermined^ attenuation ^vl; v the scene B (hereafter; referred -to^ as sound A; and? 
factor of each sound information- itcan be obtained by £:.?;*;sound B)?;Tne waveforms are read out fromthe.storage 
displayed figures -including a lateral'. barifigurevdisplayv/.O' device 506 = At: this^ timer- a^ splice position 'between; n 
portion 126. A lateral bar 126A corresponds- to the - 25 . scenes is denoted by 125. ertt :z ■ -? s . ! , r . 
sound A -tThe , vertical: width fof its black portion repre : ' «" The explanation of the elements having the same ."■ 

sents the volume control level set for the each predeterr t :: .. numerals as FIG. 17A .is omitted. *•: Numerals* -136= and ^ 
mined period '?of the ir. sound Ai:rA clateral x bar i -126B - .137 denote I edited 1 picture? irhage- stream and" sound > 
corresponds^ the sound B.>:The: : vertical: widthrof its: - 'vcimage stream.^ ;c rises k-ni?toiis yd c&z bcteulw- <mJ 
black portionrepresents the volume control level set for * 30 By referring to FIG:>18; the sound editing process^ w 
the each predetermined period of the' sound B;cO ; oft : v: r . « :ing using the lateral bars^126Aand>126B in this embod^ vc 

According to the sound editing of the present inven-u t ; iment will now be described.) By coriductirigca sirriple.t^. 
tion, not only the sound amplitude level but also a differs o.-..^ work of -only .'specifying \four rwhrte^ circle^igures^g^c: 
ent sound parameter such as one of a plurality of sound i-'** ^through '1 32- andt moving • themMn trilateral: directions 
quality levels or the musical interval can: be^adjusted in -sr 3s:\-i while watching the video image, the operator can" arbi- s 
an arbitrarily- specified- editing v sections For cexample. rv« trarily set various parameters: required for editing, such'^- : 
white circles 129 through 132 on the bar figure 126 are r-as a sound 5 A attenuation; start point position 521,. a V : 
icons for specifying such adjustment? sections 1 of^ ^the ?.c.^ . .sound A attenuation end point position- 522, a sound Br;^ 
sound parameters The;obFiquei slant portion of the bar augmentation start point position 523; a- sound B aug-" f '* 
f igure 126 represents a gradual change of the sound 40 :: mentation end point position 524; split values 525 andt 
parameter. Button icons 631, 632 and 633 for specifying 526. fade timeUengths 527 and 528, and a transition: 5 
the sound amplitude^ level; ^v SO und^ quality level, and*--^ time length 529.: v jboco l o.-^-r.cui q^.aU 3&« 
musical , interval mays be- provided- in Mhe window as - • : - ■ For example, it is now assumed that the white circle ' * 
shown in FiG. 21i The operator selects^ a sound pararrv figure 129 is subjected ; to:' mouse drag v and thereby: " 
eter to be edited by clicking any one of the button icons 45 moved from the position 521 of (a) of FIG. 18 to a posi-' 
63 1.632 and 633 with the mouse: If a button icon 634 is tion 523 as shown in (b)' of FIG:18. In that case, the w 
specified with the mouse, the sound in the editinig sec- - attenuation •> start point position 521 of the sound A ; 
tion (at the time of fading) is subjected to an echo effect. * becomes later by; for example; one frame of the images. U 

The white circle figure 129 is a setting icon for set- • Accordingly, each of the split value 525 and the fade ' 
ting a level attenuation start point of the sound A. The; 50 : time length 527 of the sound A and the sound transition ' 
white circle figure 130 is a setting icon for* setting a level - > time length 529 between the: sounds A and B is'also 
attenuation end point of the sound A! The white circle :• reduced by, for example, a value corresponding to one ' 
figure 131 is a setting icon for setting a level augmenta- frame. As a result, the sound A attenuates quicker than 
tion start point of the sound B^The white circle figure • ' (a) of FIG. 18: ' ^ ' v " ' ' 

132 is a setting icon for setting a level augmentation end 55 - It is now assumed that the white circle f igure 130 is - 
point of the sound B. . r" ! moved from the position 522 of (a) of FIG. 1 8 to a posi- 

The image stream 121 and 122 of the film image: tion 530 as shown in (c) of FIG. 18. In this case,' the 
sound waveform display portions 123 and 124, the lat- attenuation end of the sound A is made later by, for 
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example, one frame/ Each of the fade time length of. the & < ^ This embodiment is configured so that editing may r - cu 
sound A and the sound transition time length between An ! v be conducted in the same way also in the case* where { ■ c r\ 
and B increases by, for example, a value corresponding; .^iJj;speciaJ* effect processihg:of video images such* as the* 3*v \~ 
to one frame:.The sound- A x attenuates more~gradually>v ■ wipe or dissolve: is' desired to be conducted in a splice -stf-cro 
than the case of (a)/rf Ft IQ I *18.a^.y^ : : «: .-.^,-1^.:.^ ^ur^s position between scenes. Hereafter, operation of sounds* ivsc 

On the other hand; it is now assumed Jhat the white*-'??-, editing accompanyjng : the^effect edjting of video images^ >u 
circle figured 31 is moved from the position 523 of (a) 61*:.. ,o will be described.^ Q3 gpjjfoUtfiuy&s: » ^vv*n ?>r\g feniir.^ii *; 
FIG. 18 to the position 521 as shown in (d) of FIG.\18. In <* ; A shift to the ecfiting mode at thistime isrconducted a .-- 
this case, the augmentation start time of the sound B isn.- by an operation similar to the above described 'overlap t r * ' " 
made earlier by,* for example, one frame. Each of the jo editing, lathe main window shown jn FIGx16;.the icons -■■ 
split valuerand-theifader time lengthrof ?the-rsoundrB?-:i;>-i<.422 and 425:are clicked with the.mouse 509: Thereat- ; - ^ '* 
increases by,:fpr example,-- a value corresponding to one?: » ter, a special effect processing button. 428 or. 429 such^ vv;«::u. * 
frame. As a result,: the sound B- augments* gradually >ce* : -'as the wipe or dissolve included in a button group 426 is ! ? 
from an earlier time: np-.-q as v hvns:?*-: isnr-s^sn; •- *. ->ci yr. clicked. Asa result r theelditing^screen.420after.the shifts.* 

It isnow assumed that the white circle figure 132 is ; : ; tsm becomes as shown. in, FIGi^ltf&uafrtf y noitenvK::- i;-n jo;* teu: 
moved from the position 522 of (a) of .FIG VI 8 to a pbsi- -jn« v? The display jsaeenMoiFIG^ 21^is ah editing: screen?: .-nsn>. 
tion 524 as shown in (e) of FIG. 18. In this -case, the * microf the •; case * where ijth'e-v.wipe>i processing! hasv.been>: U°r> 
augmentation ehdr time of the sound B is madeearlier* " ; selected by the operator. Here; the. image.s1reamsi121:.iHr. o i* 
by. for example>6ne.frame. Each of the fade length of^ .ijtc.c and 122, sound waveform display portions:! 23 and 124 eA 
the sound B end the -sour** transition time between; AuVSo respectively of' the sound. A and the sound Brithe lateral pr.iw 
and B decreases by. for example,- a. valuexonesponding nr; ; sncbar display portion; 1 26; the lateral bars;126A and 126B;r.r~ . or! 
to one frame. 'The sound. B:augments faster. v*sri; i r.o.v r .v=lthe display interval setting icon;1 28, the display position fcm\>tr" 

By doing- so;* therefore,-. imthis embodiment, editing: setting icon. r127j.i and thes white ft circle:. figures^;! 29: rz) v?* 
can be advanced easily, so that the sound may be heard through (132 are .the! same: as the. foregoing descriptioniy£!q«>.'f 
more smoothly even at the slice position- between - .25 conducted wither eference.to FIG: 17Ari ;£ : : >{ .>'- 32 r for':-, 
scenes. e; . : - ? c..*vvv- zirwtwte &r*- : to twtenFM.™.* In FIG. 21. numeral .605 denotes pictures after edit- op'.»\* 

This embodiment is configured so that the' move^: : ; ' ; ing obtained by: conducting the wipe processing on the .?ir.»v' 
ment of four. white- circle figures t129,- s130;< 131; and -132 picture A and the picture B and displayed in a film image be.rv**- 
may be conducted also by clicking each picture*: of . : /r. form as a contracted moving picture stream. -The.kind of c^o . 
image streams cl 2 1f and:1 22 idisplayedroh the; screen v-t-30 the.wipe:effect'at this time is.determined.byrthe opera-: j 
420 by a film.image. wrthithe mouse.' Furthermore^his^! yr tor's selection for.wipe patterns 606.c-q bsrunvs-3*?tei-.q Hoes t*> r » * 
embodiment is configured so that the position, of the \at-:, c-rm Numeral 607:denotes: ailateral bar display : section: ; A 
eral bar display portion 126 itself may be dragged with; <p representing the: length: of theiwipe. between the picturecr 
the mouse, and association of the J vkJeo pictures wrth-Q x- A and the picture B. fTwo lateral bars.607A and.607Bt.: ^ * 
sounds may be shifted- :>o e 1 ^ $$&r ; o«ib»\ r. ^ 1 nn:r^t«w 35r;.v represent the lengths: of the portions in which the picture ' . 

The embodiment is configured so that the result of? yii--,;A and the:picture B are displayed;: respectively.- ^ There? u. r., 
editing may be determined at' the end of the- work- by -g -ifore, the overlapping portion of the lateral bars 607AL ..*:«• 
clicking an OK. button :1 35: : 5 3- tf»ic-e; !ms 'vr ftu A bnuo : and 607 B represerrtsJhe wipe length. pnix-i^Qc- •<?■ >r : 

Thereby, moving pictures- edited: so as to incorpo-ii ^.jr. The function.of. determining the degree of attenua-; \ l\ 
rate the::result of manipulation -are stored: in. the magr ^^r tion of the sound A: and augmentation of the sound B in. - . 
netic storage device 506. At the same time^an.alteration M- v . the overlap portion is implemented by the lateral bar dis?r - 
of the tree structure information is conducted. As a .. play portion 126: At this time, the white circle figure 129. vc sr: 
result, the display of the tree structure on the main win- - provides the attenuation start point pf the sound A, andi \ - 
dow of the moving image editing apparatus js changed >the white circle figure 130 provides the attenuation end r. , 
as shown in FIG. 19. At this time, the information repre- : -45. point of the sound: A. In the same way, the white circle < 
senting that the editing including the; sound has been::: i figure 1 3 V provides. the augmentation start point of the - r 
carried out is also displayed on the. main window of the«,. ': /. sound B, .and the white cirde figure 132 provides . the r '.:.•<:- ♦ 
moving image editing . apparatus - as; a .figure, .1001 : of. — ■ augmentation end point of the sound B. • : :j =: 
FIG. 19. ■.••* r i- ■ ; } i>' r.-o. ..f.ib-r-j ; : In these. displays; the operator can select an arbi- ^ 

In the case where the operator wants to. confirm theio'so* trary range for display by manipulating the display inter-. 
editing state before determining the*, editing, t a PRE- -;: - val setting icon : )128.:i By: manipulating : the .displays - • 
VIEW button 133: of .FIG. .17- may be clicked by the r ,x, position setting icon .127;, the operator can select an^j- y . 
mouse. ' ■»£»-.-, ., Jn -<»..- ■:*■-••' .-i..;-- = > ~ t - arbitrary section for display. At this time, the cut streams •. . 4 . 

As a result, video pictures having a size of 640 by : c ■>: of the film image.. the sound waveform display, the bars.;.;,: 
480 compressed. by the picture compressor/ expander . 55 and the. icons are mutually linked. The result of manipu- 
51 1 and stored are displayed in a window 430 of the i? / ' lation for each bar or icon is immediately reflected to. > - 
monitor 508 as shown in FIG. 20." The editing state can'. each other. . • 

thus be confirmed easily. The effect editing processing using the lateral bar 
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display portion 126 will now be described by referring to 1 .; ;-.-ucXthe scene represented' by the icon:1303 displayed, by 
FIGS. 22and 23?JiJorc = -u lodrcv 9.-- is'rou i»:3i;r..-o:> ?i ^the tree structure :,showm in r FIG. . 14 -will; now'be.': u\\?.r: 

By manipulating the lateral bar display portion 607'-^ -^'described: >'u id. wi?rn .■>:.- isn; ■■;*•?>.; .sk nsrc o;. . 
and the: lateral* bar display portion c1 26- while watching) 1 - First "of-'ali. manipulation preceding the'shift / t6 r the- ,jsj, ^ ; v 

the moyingiimage streams^ 12 1 r and, 122 each displayed^:5yv. sound mixing editing mode wi II now b e"descr ibebM : * -'• ^ 
in a fflmJimageVformrahd the; sound waveformr display ibofn In this case/ 1 a* first • requirement's" that'-'s^ - F'*' 

portions?.! 23 and. 124 as shown :iri;FIG* 21V the operators . ^containing the BGM .is -stored in-.the magnetic "storage 
conducts the overlap editing at the.time of special effect^ t>=;odevice 506 beforehand;oi!c-j^"5o- nrjic:"ss"Quc ^r ->>-« br-uo 
processing of images suchfas the wipe arid dissolved ? A\ ! On :this k premise;; a command; foraeading out this;:!*-i- ; -v: 

First of. all.' (a) of :FIG^22: shows such a-state that^n io^. sound data into the present editing apparatus: is ;given - • . 
the operator, has providedithe picture; A^and the picture 3A via the mouse. or. keyboard 509:? ■>■) rat i-:wone ^s*;* alj :« .' 
B with ant overlap s portion: by: manipulating/ the c lateral- b^oir Thereupon? the> GPU, 501 cr eat esvam icon d 1305.-^ ^.w^-. 
bars 607Aand607B with the mouse. r The length of this' ' ^ ;.'r (hereafter referred to- as sound icon) displayed as same > to 
overlap port ion becomes the lengthrof ithe.wipe^ r i 'A'Am a J Q as the icons: 1 302 through^ 1 304 of the' moving pictures . no 1 !* 

At this^timepithe lateral . bars i126A\ahd .126B are :75 s , shown in FIG.i14. l i-: $eia! s<U no £C£ s'tij^H art; .oimesSJ 
linked to the manipulation concluded on the lateral bars v The sound icon ,1305 required to Handle sound data^ K,i* 
607A and :607B,1*and: automatically brought* into^the:! on the editing apparatuses thus;setrThefeafter*; byTctickrTt s<ti ;*j 
state shown in (a): of FIG: 22i^b si *< .insva m v, *;v..v.h..'?o'.ing this:sburid icon/1305 wrtrfrthe:rT^se :in the. sameKv 

It isrnow assumed in thestate>of(a)?of FIGst22 that ■* flic riv way as the icon of the moving pictures^ it becomes pos^ : ; o;.o - 
a white circle figure 129; is dragged with" the: mouse toVizooosiWe to conduct sourid- reproduction and insertion wortetoitoo:- 
move to;a position shownrih (b) of FIGr; 22: Then a 1 splits ? --»c . i The method for shifting tothe sound mixing editing tc? * 
value 71 5 of the sound A cbnes^hdingtOrfor"example,^ o- rvnmode will how be described.* en i .beifeiisyili ior. nauortti/-. 
1 frame>is generated: Each' of 2 a? fade ;time:: I ength 5*7(17 ^ -?v< There: are the following two ways: of shifting to the" :>':: ■. 
and a sound transition time length 719 between A and B ^: ^ mode. In a first method, the sound icon 1305 is dragged o W-*4v 
increases' by awalue< corresponding if to? for' example. 1; 25 with the mouse and dropped at the icon n 303.* In a; sec-'! ~ 
frame. Thus therattenuation start of the 1 sound A can be . -vrrjtond method; the~sound icon 1305 and the icbni1303'arestl- fu- 
made to begin earlier than the start of the: wipe- »*■ ■ -.-rfiyriv selected, and a predetermined button of a button groups *V. cC r 

On i the". other; hand, if' a white, circle^figure? 130 is . < 426 is clicked with the mouse. As' a result' the: screen :jM 
moved from the state of (a)"of FIG. 22 to the position oi ' . v display is changed; and the editing screen attehthe shift?"^" .' 
(a) of FIGf-23;veach of the-fade time -length 717 of the> 3<?c^ becomes as shown. in* FIGi*24?fc s' l :-6' i o:S zA&ViV&n- up:? n\ o -. - y : 
sound A« .and? the - sound transition: time '■'> length' 1 719'. ' f; In FIG: 24, numeral 931 denotes a contracted: mov> U ,so -n 

between A r and B' increases by<a value: correspdndihg: 1 } ^ \ng picture .stream obtained by, displaying frames of -a -bw u:l 
to, for example. 1 frame. Thus, it is possible to provide >0t fixed section of> moving images belonging: to £ scehe • ^ s". 
such an effect' that the sound^A is heard S even after: the ' represented by the icon 1 303: (Fig? 1 4)rinra' f flm image v^o s ^ ; ' 
wipe has- been finished:- 'n^sjet* .Jn9-.t v« 35. form in the same' way as the^above' described case; At 

If a white circle figure 131 is moved from the state r : this time;. the sound belonging to the scene . represented ^ r: 
of (a) of FIG:* 22 to the position^ of (b) of FIG: 23; then a-'-: by the icon 1 303 is displayed in a waveform display por-J. o 
split value 716 of the: sound B corresponding t6V"f6r. ' r ^ Ition 932, and the waveform of the sound to be mixed ( - is f - 
example: 1 frame is generated- and ; a fade time length displayed' in a waveform display portion 933 - r -: :: 6"'-' 
718 of the sound B decreases by a value^conespondingoi;4d : : The vertical width'of.-a black lateral bar 934M dis- '»s ■■: :r 
to. for example: T frame. Thus ; the augmentation start of :* 1; - played in a lateral bar. display portion 934 represents the"' ■ • B ' - • 
the sound B from the wipe start position is delayed. w?l v j . volume control' level set' for the each predetermined ■ 

If a «white circle figure ^132 is' moved from* the state sritem- period of the sound to'.be'mixed. A L white circle figure" 
of (a) of FIG. 22 to the position of (c) of FIGr 23. then the^ < . 935 represents^ a 1 mixing' augmentation completion > : 1 "-: 
fade time length .71 8 of the- sound B decreases by a ^ 45; - point ^ ; .if-'os s-*' S'Kt-r,:.-: ;;' >?; 72*3 i('. m . : 

value corresponding' to. for 'example. ^1 : frame and the *- Here, each of the display position setting icon 127. : : - 
augmentatio"h of the sound B is completed earlier than >.■* the display interval setting icon 128. the OK button 135, ; 
the wipe termination' time.c ' oh- r-ri- :.i br^"M^i^:- , and the PREVIEW button 133 has the same function as ■■.*•«»■.•• 

In the special effect editing of images as well, there- - that in the case described before: Those figures, the film • 
fore, sounds' can be heard more^smoothly:. '■ 1 ■*'-•* -so image, and the sound waveform display : are ^mutually '-^^ 

At this- time as-wetl^ determination of the editing : linked. Thus, results of manipulation for respective bars 
result arid confirmation using trie image reproduction- - and icons are immediately reflected to each others 1 v " l l> , .H 
before determination can be conducted in the same way - ' With, reference to the mixing editing screen of FIG. ^ 

as the above described overlap editing in a splice posi- : 24. the operator can first set a sound mixing augmenta- f 
tion between scenes:' - ' ' < - ; '55 tion completion point by specifying -the i white circle fig- ^-- 

As a concrete example of the sound mixing editing ure 935 with the mouse and moving the figure on the •>'• 
operation according to this embodiment: the^ case of " 1 1 lateral ba'r '-934M while' watching the moving picture - 
editing where a BGM (background music) is mixed with stream 931 displayed in the film image. 
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At this time;. the lateral bar 934M has.a function-of-:*? e"* using the editing screens shown in; FIGS. 17A. 21 and /: *-svl::3 
gradually augmenting the mixing sound at the' time of •**; - 24 is conducted under the control of a computer, will now* ' *7; : -< 
mixing start as illustrated so that sounds may be mixed t>v>at%rbe descrtoed. ;p : cc vs'-qam v ? d art) tr^at^^em 

without unnaturalness. ^though ,npt illustrated, the lat- fiq. 27 is a flow chart showing the procedure of the?n: 
eral bar 934M k has also a function of gradualjy : attenuat-. :.5,j overlap: ec5 ting shown iri.FIG. 17A- If the overlap editing or- . or*: 
ing the mixing sound, at the time^pf. mixing end.Q £ ^ , : - ■ ..; mode is. selected - by . the operator* "RED R AW^FLAGV. b \ m < 

In thjs embodiment, it. is ' possible itor provide the*v£j .set in the memory 502. ir-f. initialized, to a. value, of ^ 
sound mixing augmentation completion: points even by ^nr.i ' step 140/ At step 1417 the .window, 420 shown. in^iFIG.-' ; 
clicking the moving picture stream 93 1 displayed in the O 1 7A is displayed on the monitor 508^At step 1 42/ inter*:.- ■ 
film image with; the mouse pnirto !'»v35iq s-rii ojr,- cie--. ;>io. vrupt input processing from the molise 509 is conducted.. 1 

If in the state shown in (a) of FIG: 25:rt is desired to zt 4 ; At step>143r I ftUs. determined whether anf.event:ofv-,c; 
make a.frame 931 F^nduded in the picture 5 stream. 931-n: pressing: the setting ficonxl 27 has .'occurred/ : rf the dis- nnw ti 
the mixing augmentation start point of the sound inform s--. »*r play position* setting f icdn-127> has: been pressed;. theC^ v -r : 
mation, : this . frame : 93 1 Fc is d icked with i the mouse:.- In, $n) -if "RED RAW_FLAG" is' set • to a value oKlftat step ; .1 44. c;* ;*•*::-• 
linkage thereto, the figure 935 on the lateral bar.934M ms,. - . Furthermore; a.display 'pbsitiomspedfied by the cperar • 
representing the level' of the sbund,to beTmixed is moved * ""' tor is written into: the memory 502 at stepd 45: s n srtj c ; *>*;> ! r* 
to the f rame.93 1 fu as shown in:(b) : of F \G.\ 25:qsa U ibe ? ill no rf it is- deter nrrined^at the :step..1 43 that there) is no.* A \ 0 <? 

Then- a- white xirdeNfigure' 935, < is (moved*, with, thes*^.* occunence of an event, it is determined :at stepn146i^ -;i 
mouse as shown in (c):cf;RIGr:25.3Thereupohrmixing is ?.s , : f?.\whether an eVent of pressing the display interval setting^ i* 
conducted so thaHthe sound : volume; control. I evelr may o? 200 if icon, 1 28 has :occurred:h If lthe;display : position ! setting o r, : v . 
be gradually increased in, a section 936Sri? bc-lfem a*;T icon 128, has been pressed,: the;}" RE DRAW_FLAG"iis.*; ■,■,•:■-■*> 

Although not illustrated, the enditime; point of- the v &\z .set to a value ot"1"'at stepot 47^: Furthermore, a dir^lay * 
sound mixing cam also be specif led; on~the lateral ban r-T interval specified by r the L operator * is - written" into, the^ nr ,s 
934M of the sound iwith the mouse: ortJ .bofitt-f:; j? p, n: six,- memory* 502 at. step 148.'-: r\ rt'or-i-i wil nr,-"i.»rva.j bour.^ r- bn* 

In the case where the editing: processi ng* is finish ed-. ; vzs 3 , : v If it is determi ned at • the ; step, ,1 46^ that there is no .-s * * . ■ , 
and the editing.result is to be determined;, the OK button™ •*'-.■.:. occurrence of an event;:«it is determined at- step i1 49* ?nr^ 
135 (FIG;;14) is clicked with the mouse.?;?^*^ .q r v^h X^:' 1 \ r : whether an event of pressing any. one of sound paramt 

Moving. . images 1 f, with • the results, of; thev editing Jeter icons (buttons) :631 through 633 has « occurred.^ If ;,C 
processing heretofore* described reflected therein are v.- ;:;2!. any one of sound parameter icons 631 through 633 has bc-v*c,'-: 
stored in the magnetic storage device;506* At the same. - 30 been pressed, the "REDRAVV_FtAG" is set to.a value,"of c 
time, alteration- of the^tree structure information .is~con-r -i "1 " at step 1 50: Furthermore,.a kind of a control param- ?.n >; 
ducted. As. a. result, ^the display* returns; to the original; : v. eter specified by the operator "is written into the memory.o^ v. 
main window. At this time.tthe display of, the tree struc-j -v. 502 at step 151. -...•j'asoG .Bf.r * prr.«V .e'cms'.* % -o\ .0 
ture becomes as shown in FIGP.26: In the same wayaSr^v If it is determined: at. the -.step -149. that there is no : ! :.;. 

the above described case; the .information ^that the mix- ; 35, -occurrence of an event, it is determined > at' step *yl 52*>. -i r^r.v 
ing editing of the.soundiinformation .1305 has been car? : r - whether an event of pressing an echo icon (button) 634 r> " 
ried out is displayed on the. main;yyindow, .130 V as ca. y-u .-has occurred. If.the; echo icon 634 has been pressed.V; 
figure 1101: :*d tv r-rv.-rv «n' ic, rmotsv^w ;>n, s^*= :c:the "RED R AW^FLAG j is ^ set to a value of M" at step v. •■ 

On the other hand; if it is desired to confirm the edit- . ; .. . .153. Furthermore, information of. the echo effect is writ- ... . 
ing state.betore.the; completion of the;editing work;;the ~4o ten into.the memory, 502. at .step 154. - .^ij '.: - ?r*i 
P REVIEW button is clicked with the mouse.-.Thereupon, ^ , 0 If it is determined at ,the step .1 52 that there is no 
the video; pictures, having a size of 640 byv480 com- - : | occurrence of an:evem.oit, is, deter mined at step .155 : 
pressed by;the picture compressor/expander 511 and r-o v .whether, an event of pressing the;white circle figure 129 r. 
stored are reproduced on the monitor. 508. In the same • has occurred. If.the'white cirde figure 129 has. been . .. 
way as the case described before, the editing state can 45 - pressed, the TREDRAVV^FLAG" is set to a value of "I" \,: 
be thus confirmed easily. ' .-co /:vV;*-*.i- rt: *: .:; <■ v- at step 156. Furthermore, the fade out start time of the * 

According to the present. embodiment, the.relatipn ; .j.; ~ sound A is written into the memory 502 at step .1 57. ;e; 
between the picture and the sound is obtained; so as to ; y If it is determined at the step 155 that there is.no 1.-. r 
be quite obvious.^ VVNIe. watching- the; video pictures, : J occurrence of an. event jit is determined at step 158 • 
therefore, it is possible to easily determine, amend and « so .- whether an event of pressing the white drcle figured 30 ; - 
alter the sound editing point.- i. ^ ^ ^ n kv ?.j:usf >. • *>: - *. has occurred. If .the white circle; figure .130 has been -> 

Furthermore.- according to. the present .invention,;,:. pressed, the."REDRAW_FLAG" is set to a value of ".IT*, 
pictures used for editing are obtained as intuitive dis-' V at step .159. Furthermore; the fade.out end time of the? 
plays akin to human sensitivity. In sound editing, there- ' sound A is written into the memory 502 at step 160. :.ri" 
fore, skill is not espedally required: In this point as well;. 55 If it is determined at the step 158 that there is no * 
the editing is. facilitated; «= rM-. occurrence of an event, it is determined at step.r161 . .. 

By referring to flow charts of FIGS, 27. 28 and 29, * whether an event of pressing the white circle figure 131 .. 
procedures of the case where the editing processing has occurred. H the white cirde figure 131 has been • 
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pressed.: the "REQRAWtfFLAG" isset to a .value rofi"1*4?K! *r\the steps 145.v.148.i151.M54v 1 57*. J 60M 637*166. *169.b«ejs><.. 
at step e1 62.- Furthermore,- the. fade in start>time.of.the: . c^ii. 172, and. 175 is conducted, ;it is determined:at step *1 82 -p^ - 
sound B isiwritten into the memory\502 at'stepr163?m is* *:rtv, whether the ."REDRAWlFLAG" is^TArf;rt. is determined- t>ni.»:.-- 

If iris' determined- aitHe^s1epi361?.thaf there^is';hb' f.n? : .at the sjefc:18**.tha^ \\ 
occurrence of an event^'is^dete *c#respona1ng>jto n ^ contente. is, gfefcev-.u.xi-c 

whether an event of jessing the* white circle figured 32 hs*: splayed pn ; the ; monitqr, at step^l^.^ui^enpprej .the^^n,, 
has occviredr'rf'-tHe^ white drcfe-iigure^*132^ has~been**~< processing/etumsjfp me^step^l^a lf : it r is.determined ; at oe . , 3r . 
pressed:? the i-REDRAVi/£Fi^^is^set% a'value 61*1^? ^fthe step.182 that; the cREDF^AVV^FL^Q^ ^jsinpt^1.^ the >:i . v -via 
at step 165. Furthermore, the-1fadriri> rf erid tfltehbf ihtf**» . processing return tpj^e.step^14pij sTiornisr^ii'-t Cc : rs 
sound B is written, into the memory 502 at.step 166..5 5^ \ io If the processing? of the stepi.1 78: is; conducted j thai iy; m 

If it is determined at the? stepVI 64;; that' there: is/nb>i -z-c. ^ overlap: editing.mode is once .finished.!?; t&civr^si&b v. i 
occurrence.- 1 of ^an revenV it: is; determined at {step i 1 67.* \ Next; FIG:- 28. is a flow chart showing.the procedure* ' < : &i r. 

whether aneyerrt of pressing the (picture: stream i1 2 Ijhasn sri vof the wipe editing: shown* ih>FIGr' 2p :lf the:. wipe.editingis':-* re- 
occur red r: If -the: picture stream 1 21 5 has been pressed; ? ; • « mode is.^ selected byJ the^operator;ft"R ED RAW^FLAG"^ . > LJCioe 
the *■ RE D R AWr_FLAG "~ is; set: .to i a^ value :of "Iv^atl steps 75 R set: in the memory 502: istinitiafizea\to:a value" of \"0?iat3R «.»it 
168. Furthermore? the -fade irVoutttime:- informatibmof i&v - -j step 240: At step 241 • thewindow 420 shown in.FIG.> 21u' &S*?. 
each of the" sound A and1he;squhd>B is wfittenMntoithe:^ ; w v ??is displayed, oh ithe.monH6rt508i?At step:242 ,*t interrupt «o tl.r.b 
memory.502 according to the preselected state.of e'achqe;? v input processing from the mouse 509 is cohductedsC^ v»or s -.'..x 
white circle figure at step 169. bsfc-ubno-s SOc At step 243, it is determinedewhether an* event; of b s>:*:iv.« 

If itJ is .determined at the 1st epr»1 67 that there: isrno U20 pressing, the settingricori:i2Zshas:oc^^ r, 
occurrence dfcan seventy rt'ris'det^^ position) setting iconr 127: has been pressed, the-si »u:^jo 

whether an event of pressing the picture ; stream;1 22 has - n=.. ^ . rREDRAVV_FLAG*f isf set. to: a value; of *?1 ?c at step 244. »i i! r, 
occurred: If . the picture stream 122 ; has- been pressed; vj p ^rFurthermore.va dispIay.positioh specified by:theroperar •.•.>:>: 
the "REDR AVV^FIiAG" is: set. to a value rbf "1 " atCstep:- ■ ? : ; tor is written into the:memory.502 .'at step 245 =>_ WAR G3H $■..■'; 
1 71 . Furthermore; 5 the fade::in/out:time informations of x-ssxt* - If it is determined at the; step 243; that there' is no a 3 > 
each of the sound A and the sound B is written into the^: occunence of i an .'event; it isi determined att step': 246 v - •" , jk:j 
memory 502 according td'the preselected state of each;; ' whether an event of pressing the display ^interval: settings h;i ■ \i-r.\ 
white circle figure at step 172.9 b ci ;■• j: - :uv? r> s-jna •■lu^dcon 128 has occurred. H the display -position. setting^ swt^ 

If itcisrdetermined a1 : -the.step&170. that there is rwr.rirjn icon 128 has been (pressed/ the "REDRAW^FlsAGT is \< n 
occurrence 4 ; of an= :event^. itcis : determined r at^ stepft 1 73:^' r 30 z>. set to a value of j" 1 " at step 247c Furthermore/ a displays - ■. • n 
whether ah^event :.of pressing the lateral bar display;pbr>S i v: intervaJ specified:! by^ theroperatbr^is!;writtenrinto> the^f'-^riv. 
tion 1 26: has occurred. - rf the lateral bar; display portion., o: ^. .-memory. 502. at step: 248;o S«is?£>« sr.* \l .odv^uoso ,V r ^ nou 
126 has-been pressed, the "RED RAVV^FLAG" is- set to i?.v *g .-■ K if is ; deterrrfiried ; at ? thei step 246 that there isvnb?;:^ :'5«, 
a value of "1" at step 174. Furthermore";^ ^heivalueVof x.ri ^'occunehce o4'anrj^em>UtUs ! 'deierrn'riedi:at step '249 ?>u!f» - :• 
association' relation between the videorpicture and;the. i 35 whether. an::event of pressing fthe ' lateral: bar :607» has ti: Ki-.ay. 
sound is written : into the memory 502 at step 175lo m.. ;..; occurred. If the lateral bar.: 607/ has been pressed; ithe^ 1 b-.Ju«Oc 

If it is determined at the step:-173 that - there is'nos r . "REDRAW_FLAGT is set>t"6" a value of i"1" at step. 250. 
occurrence of. an :event ; : H is^determihedvat 'Step^l 76 C.r: . 'Furthermore, an overlap quantity*. of the video. pictures nrjjc 
whether an event of pressing the' PREVIEW, button 1 33 £. i : > . 1 specified by the operator is writteh-jnto the memory 502'*:;; ^ fa 
has occurred. Ifthe PRE VIE W' buttoh:M33? has been - .4o^ ia\ step 251:1 "-ftr-. rc;?\.j V7^iV : y-v-i v. :^ .. .-- 

pressed, the preview window. 430 is 6pened:on the dis- if it is determined at the step -249 that there:is r no>.^<; ^ • 
play screen at step 177. Furthermore,' the window 420 is no.'i: . occurrence^ of ^anrevent;: if is r determined' at : step: 252 ^ v £U 
closed on the display screen at step178.c^ : w<\ «~y.ro - : 1 whether an event of pressing the. white circle figure i A29 > 

If it -is determined at the* step 176; that. there is no : has occurred:^ rf the white circle figure 129< has been: * 
occurrence of 'an : event, * it is. determined at step 1 79 r -45; pressed. 'the^REDRAW^ FLAG" is set to a value 'of "1 " - 
whether an event of j3ressih"g"the OK button- 135 has;? u. at step 253. Furthermore;'the fade out start time of •the;*'-"- 
occurred.^ If the OK button 135 has been pressed, then > ■. sound A is written into the memory 502 at step 254. "-i j>.-3 ■ j.-- 
the picture (image) of the editing result Ms displayed on . oc If it is determined at. the step:.252>that'there is^ no s "ur ■ 
the monitor and the editing result is stored in the mag- occurrence ot an events it is determined: at: step 255 . ■•■ 
netic storage device 506 at step 180V x.^ npm?;:*.r; v '50 whether an event of pressing the'white circle'figure'130 -ohi 

If it is determined : at the- step 179 that there: isno' has occurred. If the white circle figure 130 has been* i 
occurrence of an event or after the processing of the 'i ■ pressed, the "REDRAW^FLAG" is set to a value -of "1" . * 
step 180 is conducted, it is determined at: step-M 8 1; : at step 256. Furthermore;* the fade out end time of the 7 - 
whether an event of pressing the CANCEL button 21 134^ • * sound A is written into the* memory 502 at step 257.* '■: T>r ' 
has occurred. H the CANCEL buttonoi34 has been -. 55 . If it is determined at the step '255 that there'is no -':. ^ 
pressed, the processing of the step^178 is conducted: & • occunence of an event, it is determined at step 258 r - 

If it is determined at the step: 181= that there is no ' whether an event of pressing.the white circle figure 131 
occurrenceof an event or after the processing of one of' ■ has occurred. H the white circle figure 131 has been 
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press ed^the.-REDRAW^FLAGT is^set to" a.valu "of e^'the steps 245. 248. 251;254, 257. 260V 2637 266; 269.>*c^. t 
at step 259/ Furthermore;^the. fade in start time of the '5 Viand 272 - is < conducted, it is determined 'at ' step 279 q?i k * 
sound B is written into the memory* 502 at "step 260::^ v.\ : x ro rrv. whether the > REDRAWXFLAG7 is' "1 ."■ If it is determined '^uo* 

If it'is determineci at tfie step : 258 that there is no* ^ -at the step 279. that the ."REp.RAW^FL^^is.ol^the v 
occurrence of afrevent, Ws^deterrriihed at'slep 261 is dis r * -..-oc 

whether* an eVeWcTpre&ing the white circle figure 132 P^yed c^the^ monitor, at, step 280.,FurtherrrK?re. f the ..<w«a 
has c^curfeyr if^tHe^white cirble'fi^re^132- has been '**™ m * processing returns to the^step240: If it is determined, at .> ir 
pressed; the r R E D RAW£FLAG ? is 7 s et 16 a value of "1" o5r: the step 279 that the CREPRAW^MQ^is not n^the - . c , 4 
at step 262. Furthermore. thVfa'de trr end time'-bf iriif* w processing returns to .the step-240* .^n^rn.ri d£? ■? ■■!. ^ 
sound 8 is writteniinto thermemory 502 at step 263f< sr* 1 -io If the processing of the step 275: is completed, the * 

If it is determined at the! step: 261: that.there isiinqfiU-icwipe editing mode is one* finished:^ \z b&fiimisiso c? « 
occurrence 4 of , an eventritiis^ determined at .step 2640 K Next; FIG.* 29 is a flow chart showing the procedures v doc 

whether an event of pressing the picture stream 121 has^ <> *■ : h of the mixing editing shown in FIG. 24: If the 'mixing edit- rvrite :1w 
occurred:0lf.the;pictufe:stream-1^ pressed;, f ing mode^c is ^6 selected: jjby^ the fok operator^ -:u;^ 

the w REDRAWcFLAG"iis:setrt6;a!value^:of "1^ at step J J5 ^"REDRAW? FLAG* set-.in.the: memory 5021s initialized^?" vfi 
265. FurtheTmbre.Mheifatfe in/out time information 6f£S 0.7M0 a value of;"0" at' step 340.* At step; 341? the.window/s r?c5 f 
each of the sourxJ:A1and!the sound B is written into the lor. :: £ 420 showhan FIG: } 24' is display ed:oh the monitor; 508.to jIdbs 
memory 502;according to the preselected state of.each:.; : : uyr. At step 342; interrupt, input processing: from the rrtbusej iorn^n 
white cifde figureat step 266bs> ?»m » yieb ci n ,«*S c*3te 509 is conducted. .£6 «' cs&Js 55 r.; ! yQ^ sisvo siiH.v. 

If it is-determined atithe-step 264 that?there is , np^TO , c. vAt step 343;; it is determined whether an event of' f t! 
occurrence of; an? event;- it is determinedk;atrstep-267oq .^.pressing Vther displays pbsition^settingr icon r 127^ has9iKcr>3 
whether an.event of pressing.the picture strearh^ 

occurredr If the picture stream il 22 has been, pressed; : r'. * been pressedrthe "REDRAWiFLAG" is set to a value of si uiv: 
the "REDRAW_FLAGt>is-setft6ra valuerof ..MoJal step v, ,."1" at step 344. Furthermore; adisplayposfobri speci-3F 
268. Furthermore.* the? fade in/out time information ;6f 25 fied by the operator is:written:intosthe memory 502 at j-? > ^ < 
each of the sound A andrthe sound B is written into the-* r.u. ** step 345: t ojn- r a'ihwpi 3 ?rw.e <rh a cr:uo«* 3f:> so <^e.r 
memory,;502 according to'the;preselected state of each«' If H is determined at the:step 343i that there is'ihopersfr 
white circle figure at step;269:fc *t\i Vt .bonuooo BSr ^occurrence of an event, it is determined at rstepl 346.0 o?*Hw 

If it is determiried^at the step 267: that.there.is nd^r vcwhether an.event of pressing the display intervahsettingii )\ 
occurrenpe.;of>an cevent? ,M lis^determined: at "step<.270& ^o; ? icon 128 r has -occurred:.^, the f display) position setting ev.i.-:>oo 
whetherran event of pressings e lateral barcdisplay por- ir.v ^t, icon 128r.has been pressed ;■ the; "RED R AW^FLAG" » is -5 nto j . v 
tion 126 has occurred. If the lateral bar-'display.portipn -r- - .-set to a value of riTatstep347 i (Furthermore. a displayj-V .-.« . 
126 has been pressed/ thel" RED RAWfFLAG" is set to i ; ^ interval (specified by* the operator 'is: written into>.the>:r ; e 
a value of "1" at stepi 271. .Further more, .the ;value of r ;m;c»: memory 502 at step 348.^ vsriirj" is « *o g-; ^v •. 

association relation: between the video picture ;and; the o fas* . : If it:is ( determined at the step 346 that- there is nor, v s . 
sound is written into. the memory 502 at step 272; ! ; !>.- . . vioccurrence of:an event- it'is determined at , step: =349 

If it '©'.determined at the step 270rthat there is ;n67.. whether an event of pressing, the lateral bar display por-i V. 
occurrence.ofi an event;; it. is,determined?)at step^273i6»ir i.-tion 934 hasioccurred: If the lateral bar display portion ; ; ■ 
whether an eventiof pressing the R REVIEW button 1 33-' .*>:- ~ 934 has been pressed;' the;'*REDRAW_iFLAG'l is.set to .trUa-tw 
has occurred. If the PREVIEW button 133 has been qjio a value of "1" at step^350:, Furthermore; the fade in start: ,.- >r, 
pressed; the preview..window;430 is opened on the dis-;, ; time of the mixingisound; specified: by the operator ■ -is;*; i 
play screen at step 274: r Furthermore, the.window 420 is- , o written into the memory. 502 at step 351. ; qa:,' -a- 
closed on the display screen at step 275:c }o ~ . . J •; w If it is determined at the step 349 that there Js no 

If it is determined at the step 273 that there is no . . occurrence of an event-- it is determined. at step 352- 
occurrence of an event, it is determined r at step* 276 r45 • whether an event of pressing the picture stream 931 has* 
whether- an event of 'pressing the. OK button 135 nasi* < ; occurred. If the picture stream.931 has been pressed.:. . 
occurred. K the OK.button?135 has been pressed, the. v.u • the "RED RAW^FLAG^ is set to fa value of^l" alstep^- v. 
picture (image) of the editing result is displayed on the 353. Furthermore; the fade in start time of. the sound is:; 
monitor and the editing result is stored in the magnetic. written into the memory. 502 at step 354: v ..^ -:' 
storage device 506 at step 277. : ■ . : ' ^ 1 r - c -&'50"\ If ft is determined at the step;352 that.there is no 

If it is determined at the step 276 that , there. is no oo sr < occurrence of an; event;: it is determined at step 355 ■ 
occurrence of an- event or: after the processing of thej-o- whether an event of pressing the white circle figure 935 v - 
step 275 Js conducted, ..it is determined at; step 278 - has occurred.. If the .white circle figure 935. has been 
whether an event of pressing the CANCEL button 134 . < pressed, the "RED RAW^FLAG" is set to a value of "1V 
has occurred: H the CANCEL button 134 has-been 55 at step 356. Furthermore, the fade in end time of the 
pressed, the processing of the step 275 is conducted:: v , sound is written into the memory 502 at step 357. v 

If it is determined at the step 278 that there is no H it is determined at the step 355 that there is no 

occurrence of an event or after the processing of one of occurence of an event, it is'determined at step 358 
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whether an^event of. pressing the PRE VIEW btrttoni,133 2. 
has occurred^H.i PREVIEWk.button.fi 33 chas ;:been 
pressed.-the preview,window.430.is ; opened on the:dis- 
play screen at step 359. Furthermore, the window 420 is 
closed on the (display* screen at step 360. . 0 } lo3e -, fv ; 5 

If it is- determinedcat the:step. 358 that there >is: no 
occurrence of an event rt is determinedvat. step. 361 3. 
whether an event of pressing the OK button 135 has 
occurred:-, fr the OK'button 135~has beenpressedj'the: -fi ? 
picture (image) ;of : the editing- result is displayed on thejouo 
monitor. andithe .editing result: is. stored in4he:rnagnetic>oq 
storage device: 506: at step 362. no ;? s \z r»s of bsMn : I e c 0/ 4. 

If it is determined at the: step 361 that: the/e7ts~ non - 
occurrence of an event or after the processing of the 
step 362 -is f : conducted, it is; determined 1 at . stepi.363rr. '-15* r 
whether^ahv.event;of. pressing the .CANGEb button. ;1 34.^:- 
has occurred.b H.thej. CANCEL button; il 34c has>beenv^ 
pressed/ the processing of the:step360 is; conducted - = jcv 

If it is determined at the step: 363\ that there! isihosn. 
occurrence of an event or after the processing of one of 20 
the stepsi345r 348. 351^354; and 357 is conducted,: rt is 
determinedratstep:364;whethe*.the rREDRAW^FLAG" 
is "1." If it is determined afc the^ step ..364jithat the 
"REDRAWFLAG" is "1," the picture corresponding to 
the edited contentsiis displayedron the- monitor at. step n. 25 ' . 
365. Furthermore. :.the processing' returns^ to .the step o.^ 
340. If fit;> fedeterminedeat rthe>£Step;?364 '.that ; the- iu 
"RED RAW_FLAG" is not " 1 * the processing s returns; to ' -r: 5. 
the step 340. If the processing of the step 360 is con- 
ducted, the overlap' editing:mode is once finished.:!:; ,> 30 

The t.edithgi processing- programs* represented by 
the flow charts shown in FIGS. 27 through 29 are stored 
on the memory 502 in a code signal form which can be 
read by^theaCPU .501 . The mernory. 502lmay ; be a - 
recording medium such- as a semiconductor. memory, a : .35 
CD- ROM . a ma ghetic disk.- or an optical disk; u> [ ' C 1 : 7 : 

It is. evident that the present . invention Jsnot I imited .r ^ 6. 
to the embodiments heretofore described; and persons 
skilled in the art may conduct various improvements 
and modifications; on the basis of the disclosure. - v: '• <o ' * 

Claims.': ! : «'■) ■»r-?F- - ».:c i, i. r-'i.-;. .\ >;■. y »:••.,:• ,«':j x v'q-.:i 
RT •?:.■: P= 1>PU0': r*}~"M :■'«-:- 'O t £"'\;f !>*■-"; .3\Jr. f i- 

1. An image information material editing method for o 

conducting editing processing on an image infor- 45 7. 
mation material with an aid of computer, comprising 
the steps of: M u.*n o;,:^ • . * i, c ; 

storing information of said image information 
material into a storage device; 1 4 > -u r**r so 8. 
reading but a= plurality of; image streams to be 
edited within said image information material 
from said storage device; 1 < .s .r>v - 

editing said plurality- of image streams' so as to 
generate an edited image stream; and bar 55 
• simultaneously- displaying the image streams 
to be edited and said edited image streams. 



An image information material editing method 
according, to claim 3 % .wherein, said jdisplaying^step 
comprises a, step ;of f .displaying ]nf ormatign r r epre- 
serrtetiyie^xpfrj editing- performed,-. ;qnu saip£f image 
streams to be edited. 

An< ; image:: information: ^material? editing- method 
according rto clai m.2,j wherein^ said} information rep- 
resents I the. positioriiiof the:: editing in> said < image 
. streams to be edited. 

bertiem grvribo is; iotas n <:o\;&^\om s$.om: 
An • -.imaged informations .material . ^editing 0 method y 
according; to : claims wherein : said- imagej streams . 
read" buti from said storage' device is^ displayedron i-# 
the' screen;Jn first ?and^secbnd^film£imagesr.( .102; ; 
103))formed by a connection: of a plurality; of frame & 
images; r.i rt-imiT^c^v siutojq wiivom bnccs^ ^: 

a kind of effect editing and an editing range to 
:. be; ; conducted ; on : said: image streams is: speci- 

vfied;and;.vojri b^ !»jf?n&fhv .* »rtiuio c: fjnibi-:-* 
i the image r streams/ with^. the tspecified . effects 
editing processing conducted .thereon is dis-r 
played on the screen as a third film image (104)/' 
together with said first and second film images 
g(102ii»103)tol &&} Qr.teooGiq y.Xte 

An ; image i information irhatenal^ editing^ method 
according to claim 4, furtheKcomprising:the;Step'Of 
creating (51 3) contacted images by.reducing pixels 
of said image: streams and: storing the contracted 
image streams in said storage device (506)70^100 
wherein the image streams of said film 
image' are created from; said f contracted images 
read put from said storage device ^and displayed:- vyj 

An .image: information / material : editing method^ 
according to claim 5r f urther.cdmprising the step 6f.^ 
representing a specif ied editing range of said image ? 
streams" by- ban figures- ( 1 05r 1 06)^ each . having a> : 
time axis as a longitudinal direction: thereof, and' 
displaying said bar figures on the screen together 
with said first tpithird filmamages. "i ^o:-: no t---.-j^c- 

An image : information .material cediting method 
according to claim 6, further comprising the step of 
altering the n editing range by altering the lengths of 
said bar. figures:- vv~ c!.-..: •: ; r ' t\: N > l s?':y*z:* c :• 

An image information material editing method 
according to claim 7. wherein in case of editing of 
mutually overlapping and coupling portions of first 
and second moving picture information,.. > ."■ »c t utft 

a first bar figure (102) corresponding to said 
first moving picture information and a second 
bar figure (103) corresponding to said second 
moving picture information are displayed on the 
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{ screen; lan.*;**?-. nt*0s>' 

sard first aho' second bar figures ar displayed" 
so tKaVancverlap region' ofthe first arid second :GJ * 

: moving pictufeirto'rm be Yecc^hrzed; ; ;9? 

pictures obtained by mutually overlapping and 
I coupling'the' first* and second moving : picture 
information in said overlap'region are displayed \-r. 
on said screen as said third/film image (1 04); ; : 

9. An image information material editing method 
according to claim 8, wherein said editing byimutu- nA 
ally -overlapping -arid couplings portk>ris:of thei-first»" 
and second :mbving picture: information is^editing^ 
processing ipfr gradually rchanging; from pictures. oUr is 
the f irstVmovirig- picture:- information to^ pictures *ofC ' 
said second moving picture information in said* r;; 
overlap region. 

03 ?:;pbi ©nilrb* nr- l>^5 on^ibe r^n? o =i>i ■•; 

10. An inriage :, .Mrrformation b material ^editing t< method 20 
according to claim 1 . wherein said moving, picture 
information arid sound informational 23; 1 124, 126) 
relating to said> moving: picture information are dis- 
played on said screen in a common time axis-vs-c; 

affirm .'mI-t b"K>:><i« QMS w.il laics- '""!"'» :eri 
editing processing (631-634) for r adjusting 
parameters relating to sounds of the sound 
•information ; in saidr editing:;- position is r com- 
manded by; the user ;: and ,a rn-cio 0? oniryiccofc 
;a result (»1 26A, .1 26B) oft editing • of the sound sr$0 
i information; commanded- according $to. said 4 o 
command is displayed on said screen:^ - : -..--.-n. 

11. An Jmage information r material editing method, rv 
according to claim 10,. wherein in case of editing of s»c 35 
displaying said moving picture information in a film 
imagerdisplaying film' images (121^122) of a plural- . ' 
rty of differerrt" moving picture i nformatioh" pieces on: 
the screen: so as. tp be;distinguishab|e from each : 
other, and mutually coupling said:different t moving-i, 40 
picture information pieces: ' ! c- ■ rv i ir.-» c «- : 

editing processing of adjusting the parameters. . . 
relating to the sounds of the sound information 
in said editing * position is arbitrarily > com- « '45 
manded by the user; and / ;£-«-> " . y - 
the result- of editing of. the sound information j 
commanded according to said command is dis- 
played on said screen, 
iv -_!*•• U. »-::v>:fir- ' 

1 2. An images information ? material ? editing method c 
according to claim 11, ^wherein in case of overlap . 
editing of mutually overlapping portions of said dif->: 
fererrt moving picture information pieces: 



's. "editing processing of . adjusting the v parameters £ r.i nv-- 
relating to the'sounds of the souhcJ informations c «*n 
in said overlap region is arbitrarily commanded ^sr^c: 
cbyithe user; and .svxn-.cf i -uH .QTiS qs:s fp *0£)cs •*:.?!« 
the result of etfrtirig : 6f the" s6ul^y-irH6rrnatidri , — ? * i,r * 
c commanded according to said command is <fis-. ,! -i 
S played on said screenr: Jr*e.V£_ss JP.aiyjS.VUwva 

*' 5f.r noKud >I^" ivtl. pni3A'.itq tG tnovo r>ii 'BrttefjA- 

1 3. Ah s image.t.informationfc material: reditihg method ^v.i;c : ; 
according to claim 112, wherein at displayed 'editing ■: *i 
position pf said'sound information is;changed so as ioj i: :om 

r to be linked to an alteration of the ? editing: position of eo£.. 
said moSnng picture information:: 1»5 lwnfmi9)isb si Ji u 
±c,i -C: ^fiiSisrrfr.fO an J 10 )nsv»; pr» h; sonftiii:r , ."jc- 

1 4. -: An c imaget informations material , editingn method's ;V q ~ : 3 

according, to dairri^l12,Cwhere/inrediting:processing:e rsj^; lv.- 
for changing -an Amplitude levelldf the:sound of :the>oc ^e*", 
sounds information irf "said 'editirig position: is! corh-^ 3 i n 
manded by the user; ahd;-3fe snt ts bs^cmsfob ai VI 
•i ^ eno to pnifjaGy.^q s-fi? >3rte "0 lr\&\f* nn to sontirsu;^:) 
a* change:state dfrtf soundllevel^ih the editing::??^ ?rij 
pdsitiph specified according to 'sad command 1 > 
isdisplayed on said screenLvvr^^itQb a ; :i J! ".r* 
*i:->Xi^ r io;. e;ifK:.q «ri} ". ! si ' "OAJn ..WAP. '.'Jr>i-!" 

15. An image information materials ieditingv: method i:!^ ^: 
according to claim .14, wherein the amplitude level .H r i 
of the sound is:displayed on the screen by? using* a nfc 
bar figure; and;:-:^o^;c!o ff-J ".«'' -0:1 &* ' DA^m^V.'A f* G 2 F 

a chang e r points of theramplitudeTlevehis.cSs^be.c . : 
played on said bar figure by< using a specif ic.f ig-c-n - ; 

iure.^- ov^ G5n0i/o"r : ! ' S .Srl'i^ rv. .-iwena 5t sertD 

ri£."> ro«;hv ftjic-^ iKm^-I* oixo ~ •*{ £0-^ y'tomerri ~-< - r :. 

16. An image ';irrforrrwtion~. material editing^ method^ J ; ■ /■ f> 
according to daim cl 5; wherein a: change start point l": • 
(129. 131) and; ^a> change- end. point (130:^132) pfK ) 
said amplitude level are displayed on said bar figure. ; 

by using said specific figure.- !oiof« :i-ri ^aa^ibaoVnf' v : 

17. An image ? information l ^material -.editing r method - ry-p 
according to claim 10, wherein in case of editing of 
displaying said moving picture information in a film rrr: 
image, and mixing predetermined sound informa- 
tion in a portion of said moving picture information: 



50 



an overlap region of said Different moving pic- 
ture information ■ pieces is displayed on ; the 
screen; : ■*« . • 



a position (935; 935M) : of the 1 moving ? picture 
information in which said predetermined sound - 
information is to be inserted is arbitrarily speci- 
fied by the user's command; s. tt *.of nr $r\r oj j 
said predetermined-sound -information is:cou- 
: pled with said moving picture. information in the 
: specified position in accordance with said com- 
mand; and o'i'vni ■ n.>2 t.t." 
,a figure (1101) indicating, that said predeter- 
55 mined sound information is mixed with, said 
moving picture information is displayed on said 
screen. - - - - 
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18. An image information material editing method 
according to claim 1 7, wherein when said predeter- 
mined sound information is stored in said storage 
device, a figure (1103) identifying said predeter- 
mined sound information is displayed on said 
screen; and 

when the user specifies said figure identifying 
said predetermined sound information and 
superimposes said figure on a film image of 
desired moving picture information, said prede- 
termined sound information is mixed with the 
moving picture information with said figure 
identifying said predetermined sound informa- 
tion superimposed thereon. 

19. An image information material editing method 
according to claim 10. further comprising the step 
of creating contracted moving pictures by thinning 
pixels of said moving picture information and stor- 
ing the contracted moving pictures in said storage 
device. 

wherein the moving pictures of said film 
image are created from said contracted moving pic- 
tures read out from said storage device and dis- 
played. 

20. An image information material editing system for 
conducting editing processing on a video informa- 
tion material containing sound information and 
moving picture information with the aid of a compu- 
ter (501). said video information material editing 
system comprising: 

a storage device (506) for storing information of 
said video information material; 
means (501) for reading out said video infor- 
mation from said storage device; 
a display device (508) for displaying said read 
out video information; and 
editing control means (501) responsive to a 
user s command, for displaying an editing posi- 
tion of said video information, altering said edit- 
ing position, conducting commanded editing 
processing on video information, and display- 
ing edited video information on a screen of said 
display device. 

21. An image information material editing system 
according to claim 20, wherein said editing control 
means (501) comprises: 

means (101, 103, 121. 122) for forming first 
and second film images formed by a connec- 
tion of a plurality of frame pictures from said 
moving picture information read out from said 
storage device; 

means (104, 105) for forming a third film image 



from the moving picture informationhwith.the .■«- 
specified picture editing processing conducted 
thefepn; andjnivofn grvvnifjsib mA an^om 

^means>iforiL.displaying said f irst tto> third -fflm 
s .images together on the screenib yelqsib 

\o yJiteiuiq b\q RCiJoarnoo s v/J bw.w serjE^- 

22. An image information material:- :editingq system 
according to: claim 21 *?furtherj comprising:* aneef~ 

;>!j53 rvo i'jsfcuonoo ed oi sgnei pmrifoe ns r;r>." 
w picture* cbr^ctirigrymea^ 

tracted moving pictures by. thinning out pixels of 
saidrmoving picture:informationand storing the 
^contracted moving picturesa in \saidii storage 
.device; andfcrjooss fcns te-.ii ttsa ri>iw tartteptf 
is means for creating the moving pictures of said 

film .image ^fromjsaid ccbrrtracted2moying<pic?w A 
•tures^read oufcfrom,said:storag>jdevice.qmo'> bn?& 

^niaiittiriOO !P»t 

23. An image video information material editing system 
20 according* to : clainV\20; wherein/ said c said i editing 

corttol means' comprises^ !0*ni bru'6:-: bn& r\c<*r*,-r; 
~uiqelb bis= no noij&njr.D 1 ™ -nrisiq gnivaTi 
means for displaying-said moving picture;infbr- 
mationnahd^sburidf infer matipn.relating.tossaid 
25 : moving: picture information on said: screen in-a 

cbmmonftime axis; aridbs \cr l:>&w>oz a* iseu 
f means; ton displaying: a result ofc editing cof ithe 
sound information commanded! according tb" a 
command for adjusting parameters relating to 
so sounds of the sound information in said editing 

position. 

24. A computer program product comprising a compu- 
ter usable medium having computer readable pro- 

35 gram code means embodied in said medium for 
conducting editing processing of a video informa- 
tion material containing sound information and 
moving picture information, said computer readable 
program code means comprising: 

40 

means for reading out said video information 
from a storage device storing information of 
said video information material; 
means for displaying said read out video infor- 

45 mation on a display device; 

means for displaying an editing position of said 
video information on said display device 
according to a command from a user; 
means for altering said editing position upon a 

so command from the user; 

means for conducting editing processing spec- 
ified by the user on video information located in 
the displayed editing position; and 
means for displaying edited video information 

55 on the screen. 

25. A computer program product according to claim 24. 
said computer readable program code means fur- 
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ther comprising:*:* >"» h !r •. j ; . ; : 3:: i pr » »\-:r: r, & .s» f ;• 
j! onie-rs^m-:; £nt;;favi **uE-fC« os:V;sr* . 
means for displaying said movingTpicture infor- 
mation 'read out from said fstorage: device on 
the display device^ini first and ^second .film s 
images formed by a connection of a plurality of 
frame pictures; and:^. 5 i^n* 'syrfRTrtoU.: rSA^v •* * 
means responsive:tora' kind of: picture editing 
and an editing range to be conducted on said 
moving picture ihforrriation;>fordisplayirig.mov- io 

* ing: picture jnforrhation: witfvthe r specified pic- 
&ture editing processing' conducted therebrvon 
•:saidi- display rdevicer in a t third film-fimage 

together with said first and second film images! 
'*Sc io e?ev.i"o;C: i>ri--»orn nn; r>nrtr,s\-c: io' 1 anserr-. 75 
26. A computer program product. according to claim 24. 
said computer-readable: programs code means; fur- 
ther comprising: 

rnstew j>n.:.be m ."iouaf«iO$r:! ostav spr>'-:i r>/-. ..; 
- means for. displaying; said moving : picture. iriforr-o 20 
mation and sound informations relating- to said rc 
moving picture information on said display 
device in a cpnTmonitime .ajcis- iand; 3a-:eiv 
meansLfor . displaying a results of; editing of:the 
> sound information commanded according to a 25 
user's command for adjusting parameters relat- 

• ing to sounds of thes sound information in said 
editing position;^ } :.<n -r^- nolle ^'.cJnj :^v;c 

:• y.Hsi&i e^"j:*t -«:--.; q o:-> cuibr- :c! bns-mrrv: 
■ : C*w ric:/^ —c"*-; Ofi!.-e w '..'4 ir. e-bnucs 30 

r.O!!iJO." 



rt.r- :" >..s: .* .. 1 w -t. *?!'" 
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TtSSJW'f: r'vr*' .* f-:*^>f?:v,v V» rr:j;i: ::.» ;>n :;.:r.*.»C« 

• •:•-■:♦! >?• -v oir-j v 1 5; :-.t3 r ; ',£0 ? * j = . : • ■ * 3 .^j-j ■ v c 
■--•i" ■ ;> .vy^-iy^r. nui:s»:";ioi:*' ixu-xv: bsni'n 

.-■u .-Tabi • •.vfc-: ot-:"* -i-^u s^f* :,?fi*-- 
"Gi'-i:. , v«orni rr-nuoe owrcv^.KV-^q £22?;' 
'C .-^e;:v -nlil «. T5 ?.t<£0qfr?::e'jju«f 
:.t>$*^ CtuO ,/*:C»: jPT*. i::: 1 rr.»::;!C ^iw-OfT: 1^? ;C3b 

^UM-f OU»S i:tW ~0M^-r'\oi r i! ar:utoki x ,n!VfVn 

bortlB*n ooifoj li»!^Jr>fn '••*> t rj5 r n-^:*i *sf-.rnf r;A ,9? 
■ '3:': ivv^iha/noo jer^iu- .0! ••r-;sl3 of t??-;U-*o^ :^ 

.. ■.: .."v a?; f r':.V'- 1 -.;o i:- 4 .-;:". 

•. «i o??b;v r. r -o :c t Qn:ribr; pnijoubre'. 

.j:".C . 5:: D;^ r\h*= nofiErnio^!; o-?v;j^;q pcivc-fi. 

• ••\\ :zr: noiJcr.'-d:;. ':::b'\ -Ns3 iv) 

:«)r.*.ii;Ci;*i:?.*. 'v-u.royc: 

• • r> •: v j:ic f .»:- -BCd; :-:;r*oc ^ 
»•.•• r nc j :s rr: o»P i '/.. i:t v mjo 
5 - : Oo. Mriiii c;fr50:. ^r: 11 ?:.- 

• - . ' ~ • • ..r-.vHSCr. .»* -so* ::rsjSr-"-rr.ci- .r^ ; 

■*. : O '.' ^-i'*^:.-, rO0£rr- 'C'.' : '■•y ; ..> DiR3 lOP.O!." 
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